Disallow crawling in robots.txt (#448)
This commit is contained in:
parent
50af6499b0
commit
323ad9f9e2
@ -1,2 +1,3 @@
|
|||||||
# https://www.robotstxt.org/robotstxt.html
|
# https://www.robotstxt.org/robotstxt.html
|
||||||
User-agent: *
|
User-agent: *
|
||||||
|
Disallow: /
|
||||||
|
Loading…
Reference in New Issue
Block a user