|
|
c41bb9dd7f
|
Allow entire site for robots
Signed-off-by: Jim Martens <github@2martens.de>
|
2018-01-09 16:31:30 +01:00 |
|
|
|
98bb5d2b8b
|
Added sitemap to robots.txt
Signed-off-by: Jim Martens <github@2martens.de>
|
2018-01-09 16:25:13 +01:00 |
|
|
|
c0d4a0a5c9
|
Added robots.txt to block assets from bots
Signed-off-by: Jim Martens <github@2martens.de>
|
2018-01-09 16:02:01 +01:00 |
|
