Seo Panel Forum

I have only recently installed SEO tools and tried to generate a sitemap in XML format and it only generated a map of 21 URL's however my site has far more pages than this 100's of URL's. I can't find any settings that I need to change can anyone provide any ideas of what is causing it to only read 21 pages?

Could anyone tell me that what significance of spider in search engine and how they works for our site?

Spiders are the automated programs that are crawling the web all the time to get up to date data for search purposes. The spider visits the given URL, gets all the hyperlinks in the visited page, saves the new links to the URLs list to visit (crawl frontier), saves the page itself to a database file, traverse the URLs list, pick a new URL to visit, and do the same cycle again.

I used some XML sitemap generator and had no problems with reading urls. I'm not a professional, so I can't give you any advice on this. Just wanted to say that maybe you should try another tool.

The HTML Sitemap Generator tool can be used to make HTML sitemap webpages for your website.It creates a sitemap for the site, plus a google sitemap, and it does include the Itemid.

I recommend Sitemap Writer Pro, try, http://www.sitemapwriter.com/download.html

perhaps you do not have links on all your webpages, or they are not functional, and hence the sitemap generator did not include/see these pages? most decent onpage seo tools will first help you fix broken links and then create the "right" sitemap for you.... this worked for me when I created sitemap with website auditor tool

Use google xml sitemap creator to create google xml sitemap. It's best way to create xml sitemap.

We have tried a variety of site maps, XML Sitemaps found to work best. It can automatically run on the server, and create all the map versions (XML, ROR, HTML and text). When your own website, you can try for free. smartfindsmarketing.com / xml_s.

Here I sharing free Sitemap Generators. The page below is from Google's help site and lists 3rd party software. I happen to use Gsite Crawler which is donation ware. I thought it was worth a donation. Here Source: code.google.com/sm_thirdparty.htm.