The Best Custom Robots.txt & Sitemap Code For Blogspot

Having a functional Custom Robots.txt file and submitting your Sitemap to google is one of the most important things every blogger should do if they want their site to be indexed in real time. With each post you publish, the Sitemap code I’m about to hand to you will ensure your first 500 posts are indexed very fast by Google bots (spiders). The custom robots.txt file and sitemap starts now:

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://yourblog.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500

NOTE: Replace the “yourblog” with your own domain name. For example,

http://top-epaymentsystems.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500

NEXT STEP: Even though your Custom Robots.txt file has your sitemap in it, you have to directly submit it to Google or Bing/Yahoo via their Webmasters Tools. This is to inform their spiders you now have a Sitemap and for the bots to immediately start indexing your Site.
When you enter your Google Webmasters Tool account (same as your normal Google account), on the Left column, click “Crawl”, then click “Sitemap”.
The only code you should enter in the box there is:

atom.xml?redirect=false&start-index=1&max-results=500