Robots (or spiders) are CONSTANTLY checking your site, almost always starting by looking for the file named robots.txt right in your main directory. There is no harm in not having it there. If you like, you can put an empty text file there named robots.txt, and it will get rid of the error in your log files moving forward.
|