...

allow directive

How to Use the robots.txt File

Related tags