Multiple Sitemap Index Files in Robots.txt

Published 21 September 07 04:00 PM | russnem

I have been searching around using Google but I can't find an answer to this question.

A robots.txt file can contain the following line:

Sitemap: http://www.mysite.com/sitemapindex.xml

but is it possible to specify MULTIPLE sitemap index files in the robots.txt and have the search engines recognize that and crawl ALL of the sitemaps referenced in each sitemap index file? For example, will this work:

Sitemap: http://www.mysite.com/sitemapindex1.xml
Sitemap: http://www.mysite.com/sitemapindex2.xml
Sitemap: http://www.mysite.com/sitemapindex3.xml

Thanks in advance to anyone who can help. 

Filed under:

Comments

# Richard said on September 21, 2007 07:21 PM:

Try using a sitemap index file:

sitemaps.org/protocol.php

# russnem said on September 21, 2007 07:29 PM:

Actually what I'm talking about is specifying multiple INDEX files in the robots, not multiple SITEMAP files. I'm saying I need more than the 50,000,000 URLs allowed by the 50,000 URLs per sitemap and 1,000 sitemaps per index file.

# Ali Khalid said on October 18, 2007 01:21 AM:

I am not so sure about this but we do use multiple site maps on our site www.ticketnest.com. We just place url's of the sitmap at the end of the home page.

You also use the Google Webmaster Tools and add multiple site maps per site.

# Jeff said on November 12, 2007 05:04 PM:

SO I take it you just can't feed it your web.sitemap file it actually has to be a file ending in .xml? Is this true> Dro me a line and let me know please. stumpthegeek at gmail dot com

# ropo said on August 21, 2008 02:51 AM:

You can specify more than one Sitemap file per robots.txt file.

Sitemap: <sitemap1_location>

Sitemap: <sitemap2_location>

Leave a Comment

(required) 
(required) 
(optional)
(required)