by david0019 » Fri Feb 17, 2017 8:59 am
Robots.txt is a simple text file which is used to hide sensitive and private data of the website. For example, every website disallows their admin panel by the robots.txt and by this, they keep their data safe from the hackers.
Thanks & Regards
David Allen