doc: limit search engines scan on older content

Update robots.txt to exclude older documentation versions: 0.? 1.? and 2.0 through 2.4

Signed-off-by: David B. Kinder <david.b.kinder@intel.com>
This commit is contained in:
David B. Kinder 2022-02-22 02:48:42 -08:00 committed by David Kinder
parent 7c304539b4
commit d1b2b58b19
1 changed files with 7 additions and 14 deletions

View File

@ -1,16 +1,9 @@
User-agent: *
Allow: /
Disallow: /0.1/
Disallow: /0.2/
Disallow: /0.3/
Disallow: /0.4/
Disallow: /0.5/
Disallow: /0.6/
Disallow: /0.7/
Disallow: /0.8/
Disallow: /1.0/
Disallow: /1.1/
Disallow: /1.2/
Disallow: /1.3/
Disallow: /1.4/
Disallow: /1.5/
Disallow: /0.?/
Disallow: /1.?/
Disallow: /2.0/
Disallow: /2.1/
Disallow: /2.2/
Disallow: /2.3/
Disallow: /2.4/