Discuss about latest seo trends and techniques.

Moderators: hellow0rld, eugene, sendtogeo


Postby jaysh4922 » Thu Sep 29, 2016 5:32 am

Robots.txt file is a special text file that is for eternity located in your Web server's root directory. Robots.txt file contains limits for Web Spiders, telling them where they have authorization to search. A Robots.txt is like significant rules for search engine spiders what to follow and what not to. Robots.txt file is a very important file if you want to have a good ranking on search engines.
Posts: 289
Joined: Mon Dec 24, 2012 9:54 am

Re: Robots.txt

Postby RHCalvin » Wed Oct 26, 2016 5:54 pm

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Posts: 140
Joined: Fri Jun 03, 2016 6:31 am
Location: Forum

Re: Robots.txt

Postby davidsmith » Fri Feb 17, 2017 8:05 am

robots.txt is a text file webmasters create to instruct robots .It is great when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want.
Posts: 122
Joined: Fri Jan 20, 2017 10:14 am

Re: Robots.txt

Postby david0019 » Fri Feb 17, 2017 8:59 am

Robots.txt is a simple text file which is used to hide sensitive and private data of the website. For example, every website disallows their admin panel by the robots.txt and by this, they keep their data safe from the hackers.
Thanks & Regards

David Allen
Posts: 22
Joined: Mon Feb 18, 2013 12:07 pm
Location: Ahmedabad

Return to Seo Discussion

Who is online

Users browsing this forum: No registered users and 1 guest