mirror of
https://github.com/PrivateBin/PrivateBin.git
synced 2025-10-03 01:39:15 +02:00
a5730b701c
According to Wikipedia this is indeed right.. https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive Then there are only many wrong examples out there.
4 lines
114 B
Text
4 lines
114 B
Text
# Might as well keep robots away for performance and privacy reasons.
|
|
User-agent: *
|
|
Allow: /index.php
|
|
Disallow: /
|