Misc/Robots
* add sensible robots.txt expected by configuration self test
This commit is contained in:
parent
452e056499
commit
5309843d77
1 changed files with 15 additions and 0 deletions
15
robots.txt
Normal file
15
robots.txt
Normal file
|
|
@ -0,0 +1,15 @@
|
|||
User-Agent: *
|
||||
Disallow: /?account
|
||||
Disallow: /account/
|
||||
Disallow: /?account=*
|
||||
Disallow: /?profile
|
||||
Disallow: /profile/
|
||||
Disallow: /?profile=*
|
||||
Disallow: /?profiles
|
||||
Disallow: /profiles/
|
||||
Disallow: /?profiles=*
|
||||
Disallow: /?random
|
||||
Disallow: /random/
|
||||
Disallow: /?search
|
||||
Disallow: /search/
|
||||
Disallow: /?search=*
|
||||
Loading…
Add table
Add a link
Reference in a new issue