Free Blogger Robots.txt Generator

Generate a clean, SEO-friendly robots.txt file for your Blogger website.

Use your main address, for example https://www.example.com or https://yourblog.blogspot.com

What Does This Robots.txt Do?

This format follows Blogger's own default and is safe for most blogs:

  • User-agent: * applies the rules to all search engine bots.
  • Disallow: /search stops bots from crawling search result and label pages such as /search/label/seo. These pages repeat content from your posts, so blocking them saves crawl budget and keeps bots focused on your real articles.
  • Allow: / lets bots crawl everything else, including your posts and pages.
  • Mediapartners-Google with an empty Disallow: makes sure the AdSense crawler can read your pages, which helps it show relevant ads.
  • Sitemap: points bots to your XML sitemap so they can discover your posts faster.

Note that robots.txt controls crawling, not indexing. To keep a specific page out of search results, use a noindex tag instead. Google does not penalize you for duplicate search pages, but blocking them keeps your site tidy.

How to Add This to Blogger

  1. Go to your Blogger Dashboard and open Settings.
  2. Scroll down to the Crawlers and indexing section.
  3. Turn on Enable custom robots.txt.
  4. Click Custom robots.txt, paste the generated code, and click Save.
  5. Open yourwebsite.com/robots.txt in your browser to confirm the new rules are live.

Be careful when editing this file by hand. A line like Disallow: / would block your whole site from search engines. If you are unsure, use the generated code exactly as it is.