Multiple Sitemap Index Files in Robots.txt

I have been searching around using Google but I can't find an answer to this question.

A robots.txt file can contain the following line:

Sitemap: http://www.mysite.com/sitemapindex.xml

but is it possible to specify MULTIPLE sitemap index files in the robots.txt and have the search engines recognize that and crawl ALL of the sitemaps referenced in each sitemap index file? For example, will this work:

Sitemap: http://www.mysite.com/sitemapindex1.xml
Sitemap: http://www.mysite.com/sitemapindex2.xml
Sitemap: http://www.mysite.com/sitemapindex3.xml

Thanks in advance to anyone who can help. 

12 Comments

  • Actually what I'm talking about is specifying multiple INDEX files in the robots, not multiple SITEMAP files. I'm saying I need more than the 50,000,000 URLs allowed by the 50,000 URLs per sitemap and 1,000 sitemaps per index file.

  • I am not so sure about this but we do use multiple site maps on our site www.ticketnest.com. We just place url's of the sitmap at the end of the home page.
    You also use the Google Webmaster Tools and add multiple site maps per site.

  • You can specify more than one Sitemap file per robots.txt file.

    Sitemap:
    Sitemap:

  • We've got the same issue at www.riddlecrack.com. We simply used:

    Sitemap: http://www.[yourdomain].com/[yoursitemapindex1]
    Sitemap: http://www.[yourdomain].com/[yoursitemapindex2]

    And it seems to be okay as judged by the google webmaster tools?

  • The concept of a sitemapindex.xml is so you can list multiple site map xml files within the sitemapindex.xml referenced in the robots.txt.

    This approach is very useful on website siloing structure. In that type of website structure, you must have a sitemap.xml file within each silo (theme) and reference all the different silo’s xml file in you sitemapindex.xml, which, again, is referenced in your robots.txt file.

    If you guys have any questions, look up “website theming” and “website siloing” to get an idea. This is something I picked up after a training with Bruce Clay in California.

  • multiple sitemap on 1 robots.txt its very useful for seo.

  • I also used several sitemaps in the robots.tx file. Sitemaps don't have to be .xml, I also have sitemap.php files.

  • Simply a smiling visitant here to share the love (:, btw outstanding layout. "Everything should be made as simple as possible, but not one bit simpler." by Albert Einstein.

  • Thanks , I have recently been looking for info approximately this subject for a long time and
    yours is the best I've discovered so far. However, what in regards to the conclusion? Are you sure concerning the source?

  • This is really interesting, You're a very skilled blogger. I have joined your rss feed and look forward to seeking more of your fantastic post. Also, I've shared your site in my
    social networks!

  • May I simply just say what a comfort to uncover a person that truly knows what they’re talking about on the internet. You actually understand how to bring an issue to light and make it important. More and more people really need to check this out and understand this side of your story. It’s surprising you’re not more popular since you definitely possess the gift.

  • each time i used to read smaller content that
    as well clear their motive, and that is also happening with this piece of
    writing which I am reading at this place.

Comments have been disabled for this content.