doc: limit search engines scan on older content

Update robots.txt to exclude older documentation versions: 0.? 1.? and 2.0 through 2.4

Signed-off-by: David B. Kinder <david.b.kinder@intel.com>
This commit is contained in:
David B. Kinder 2022-02-22 02:48:42 -08:00 committed by David Kinder
parent 7c304539b4
commit d1b2b58b19
1 changed files with 7 additions and 14 deletions

View File

@ -1,16 +1,9 @@
User-agent: * User-agent: *
Allow: / Allow: /
Disallow: /0.1/ Disallow: /0.?/
Disallow: /0.2/ Disallow: /1.?/
Disallow: /0.3/ Disallow: /2.0/
Disallow: /0.4/ Disallow: /2.1/
Disallow: /0.5/ Disallow: /2.2/
Disallow: /0.6/ Disallow: /2.3/
Disallow: /0.7/ Disallow: /2.4/
Disallow: /0.8/
Disallow: /1.0/
Disallow: /1.1/
Disallow: /1.2/
Disallow: /1.3/
Disallow: /1.4/
Disallow: /1.5/