Robot.txt XML Sitemap Generator for Blogger to index posts and pages in Webmaster Tools
You are a blogger who wants to increase the ranking of your blog site in visible search engines, then add robots.text.
Create a custom Robots.text sitemap
Enter Site Full URL:
User-agent: *
Disallow: /search
Allow: /
Sitemap: https://www.yourdomain.com/atom.xml?redirect=false&start-index=1&max-results=500
How to add a Robot.txt XML sitemap to Google's Blogger blog?
Enter your website link in the box shown below.
Then copy it as shown in the screenshot below.
After copying robots.txt
Paste the copied robot.text by looking at the screenshots below. Click Screenshot (Custom Robots.txt)
Custom robots.txt is a feature in Blogger that allows you to tell Google and other search engine bots—
- 👉 Which pages to crawl
- 👉 Which pages not to crawl
In simple terms:
robots.txt = Instructions file for search engines 🤖
🔹Why is Custom robots.txt needed?
- Does not allow pages that are not needed (Label, Search, Archive) to be indexed in Google.
- Saves crawl budget.
- Keeps SEO a little cleaner.
- Reduces duplicate content.
🔹Where can I find Custom robots.txt on Blogger?
Create custom robots from this page. Then
Blogger Dashboard → Settings → Crawlers and indexing → Custom robots.txt → Enable


