Added another thing for this file
This commit is contained in:
parent
3601a081e9
commit
91557bb6c9
1 changed files with 4 additions and 1 deletions
|
@ -34,4 +34,7 @@ Disallow: /
|
|||
User-agent: *
|
||||
Disallow:
|
||||
Disallow: /cgi-bin/
|
||||
|
||||
User-agent: GPTBot
|
||||
Disallow: /
|
||||
User-agent: *
|
||||
Allow: /
|
||||
|
|
Loading…
Reference in a new issue