mirror of
https://github.com/seigler/dash-website
synced 2025-07-27 07:16:10 +00:00
Merge pull request #351 from nmarley/DW-324-robots
DW-324 add robots.txt to repo
This commit is contained in:
commit
eade475b83
1 changed files with 12 additions and 0 deletions
12
robots.txt
Normal file
12
robots.txt
Normal file
|
@ -0,0 +1,12 @@
|
||||||
|
User-agent: *
|
||||||
|
|
||||||
|
Disallow: /forum/find-new/
|
||||||
|
Disallow: /forum/account/
|
||||||
|
Disallow: /forum/attachments/
|
||||||
|
Disallow: /forum/goto/
|
||||||
|
Disallow: /forum/login/
|
||||||
|
Disallow: /forum/admin.php
|
||||||
|
Disallow: /forum/testing/
|
||||||
|
Disallow: /forum/members/
|
||||||
|
|
||||||
|
Allow: /
|
Loading…
Add table
Add a link
Reference in a new issue