ray/doc/source/robots.txt
2022-08-25 01:36:26 -07:00

8 lines
298 B
Text

# Algolia-Crawler-Verif: C37A60AFB138256B
User-agent: *
Allow: /
Allow: /*/latest/
Allow: /en/latest/ # Fallback for bots that don't understand wildcards
Allow: /*/master/
Allow: /en/master/ # Fallback for bots that don't understand wildcards
Sitemap: https://docs.ray.io/en/latest/sitemap.xml