robots.txt blocking urls, how to stop this?
There are about 300 urls on my site that are being blocked by robot.txt, but I did not put any robot.txt files on my site at all so why is this happening? How can I stop this because the urls that are being blocked are urls that go right to my product description pages. I want these accessible for the bots to crawl. Any suggestions on how to go about this?
|