mirror of
https://github.com/vale981/ray
synced 2025-03-06 10:31:39 -05:00
7844aeafde
as per discussion on slack, this should avoid having old versions of the docs indexed by search engines, see readthedocs/readthedocs.org#2430 for reference. Signed-off-by: Max Pumperla <max.pumperla@googlemail.com>
6 lines
208 B
Text
6 lines
208 B
Text
User-agent: *
|
|
Allow: /*/latest/
|
|
Allow: /en/latest/ # Fallback for bots that don't understand wildcards
|
|
Allow: /*/master/
|
|
Allow: /en/master/ # Fallback for bots that don't understand wildcards
|
|
Disallow: /
|