Discuss about latest seo trends and techniques.

Moderators: sendtogeo, hellow0rld, eugene


Postby jaysh4922 » Thu Sep 29, 2016 5:32 am

Robots.txt file is a special text file that is for eternity located in your Web server's root directory. Robots.txt file contains limits for Web Spiders, telling them where they have authorization to search. A Robots.txt is like significant rules for search engine spiders what to follow and what not to. Robots.txt file is a very important file if you want to have a good ranking on search engines.
Posts: 316
Joined: Mon Dec 24, 2012 9:54 am

Re: Robots.txt

Postby RHCalvin » Wed Oct 26, 2016 5:54 pm

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Posts: 232
Joined: Fri Jun 03, 2016 6:31 am
Location: Forum

Re: Robots.txt

Postby david0019 » Fri Feb 17, 2017 8:59 am

Robots.txt is a simple text file which is used to hide sensitive and private data of the website. For example, every website disallows their admin panel by the robots.txt and by this, they keep their data safe from the hackers.
Thanks & Regards

David Allen
Posts: 22
Joined: Mon Feb 18, 2013 12:07 pm
Location: Ahmedabad

Return to Seo Discussion

Who is online

Users browsing this forum: No registered users and 8 guests