diff options
| author | Bernhard Boser <boser@berkeley.edu> | 2021-01-18 11:26:39 -0800 |
|---|---|---|
| committer | Bernhard Boser <boser@berkeley.edu> | 2021-01-18 11:26:39 -0800 |
| commit | e27dd26dc72b3603c0f50796d7747fb4858af113 (patch) | |
| tree | 4d139685ae771e0854e2d9187d496253106a4572 /docs | |
| parent | 1e88b9411d54e5c15a27d4a9c2748c264cb9522f (diff) | |
| parent | 6a76b60027aa163756aace389a5c9203594759ce (diff) | |
make translate, BEWARE adds the 'world'
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/robots.txt | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/docs/robots.txt b/docs/robots.txt new file mode 100644 index 000000000..ad3189d42 --- /dev/null +++ b/docs/robots.txt @@ -0,0 +1,6 @@ +User-agent: * +Allow: /*/latest/ +Allow: /en/latest/ # Fallback for bots that don't understand wildcards +Allow: /*/6.0.x/ +Allow: /en/6.0.x/ # Fallback for bots that don't understand wildcards +Disallow: / |