We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6f620f3 commit 53a7067Copy full SHA for 53a7067
static/robots.txt
@@ -1,3 +1,3 @@
1
-# https://www.robotstxt.org/robotstxt.html
+# allow crawling everything by default
2
User-agent: *
3
Disallow:
0 commit comments