hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-05 10:01:43 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[docs] add algolia crawler verification (#28094)

Browse source
This commit is contained in:
Max Pumperla 2022-08-25 10:36:26 +02:00 • committed by GitHub
parent b6fe6156f5
commit ec3c7f855e
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
doc/source/robots.txt
View file

@ -1,6 +1,8 @@
# Algolia-Crawler-Verif: C37A60AFB138256B
User-agent: *
Allow: /
Allow: /*/latest/
Allow: /en/latest/ # Fallback for bots that don't understand wildcards
Allow: /*/master/
Allow: /en/master/ # Fallback for bots that don't understand wildcards
Disallow: /
Sitemap: https://docs.ray.io/en/latest/sitemap.xml