Robots.txt

Discuss about latest seo trends and techniques.

Moderators: hellow0rld, eugene, sendtogeo

Robots.txt

Postby jaysh4922 » Thu Sep 29, 2016 5:32 am

Robots.txt file is a special text file that is for eternity located in your Web server's root directory. Robots.txt file contains limits for Web Spiders, telling them where they have authorization to search. A Robots.txt is like significant rules for search engine spiders what to follow and what not to. Robots.txt file is a very important file if you want to have a good ranking on search engines.
jaysh4922
 
Posts: 289
Joined: Mon Dec 24, 2012 9:54 am

Re: Robots.txt

Postby RHCalvin » Wed Oct 26, 2016 5:54 pm

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
RHCalvin
 
Posts: 112
Joined: Fri Jun 03, 2016 6:31 am
Location: Forum

Re: Robots.txt

Postby davidsmith » Fri Feb 17, 2017 8:05 am

robots.txt is a text file webmasters create to instruct robots .It is great when search engines frequently visit your site and index your content but often there are cases when indexing parts of your online content is not what you want.
davidsmith
 
Posts: 122
Joined: Fri Jan 20, 2017 10:14 am

Re: Robots.txt

Postby david0019 » Fri Feb 17, 2017 8:59 am

Robots.txt is a simple text file which is used to hide sensitive and private data of the website. For example, every website disallows their admin panel by the robots.txt and by this, they keep their data safe from the hackers.
Thanks & Regards

David Allen
david0019
 
Posts: 22
Joined: Mon Feb 18, 2013 12:07 pm
Location: Ahmedabad


Return to Seo Discussion

Who is online

Users browsing this forum: No registered users and 3 guests