The meta robots tag gives you precise per-page control over search engine indexing, link-following, snippet display, and caching behaviour that the broad-strokes robots.txt file simply cannot match.
Loading Meta Tags…
All major robots directives: noindex, nofollow, noarchive, nosnippet
Combined directive support
Googlebot-specific directives
No sign-up required
Drop the Meta Tags into any page — blog post, product docs, intranet, school portal — with a single line of HTML. Your visitors get the full tool, processed entirely in their browser. No backend, no uploads, no signup.
Embed code
<iframe
src="https://www.fixtools.io/seo-tools/meta-tags?embed=1"
width="100%"
height="780"
frameborder="0"
style="border:0;border-radius:16px;max-width:900px;"
title="Meta Tags by FixTools"
loading="lazy"
allow="clipboard-write"
></iframe>Attribution-friendly: a small "Powered by FixTools" link appears in the embed footer.
Two complementary mechanisms control how search engines interact with your content, and understanding which one to use for each scenario is the foundation of correct indexing management on any site beyond a handful of pages. Robots.txt is a plain text file at your domain root that controls crawler access at the URL pattern level, telling crawlers which URLs they are allowed to fetch at all. The meta robots tag is an HTML element embedded inside the head section of each page that controls indexing behaviour at the individual page level, telling search engines what to do with the page once they have crawled it. They operate at different stages of the crawl-index pipeline and serve fundamentally different purposes. Robots.txt operates at the crawl stage and prevents crawlers from fetching certain URLs at all, saving your crawl budget for important pages and protecting server resources from unnecessary bot traffic. The meta robots tag operates at the index stage, where the crawler has already fetched and read the page and respects the noindex directive when deciding whether to include the URL in search results.
The directives available in the meta robots tag go well beyond the basic noindex and nofollow pair that most site owners are familiar with, and the extended directives unlock fine-grained control over how Google presents your content in search results. The noarchive directive prevents Google from showing a cached version of your page in results, which is useful for time-sensitive content like news articles or for pages you update so frequently that cached versions would be misleading or display outdated information. The nosnippet directive prevents Google from displaying any text or video snippet from the page, which suits premium or paywalled content where you want the URL to appear but do not want the algorithm to expose your content in the snippet. The max-snippet:N directive sets a specific character limit on text snippets, useful for subscription or metered content. The max-image-preview directive set to standard, large, or none controls the size of image thumbnails shown alongside your result. The max-video-preview directive controls video preview length. Together these extended directives give you precise editorial control over how Google presents your content without fully removing it from search.
The single most important operational rule that catches teams out repeatedly is never to block in robots.txt a page you also intend to mark noindex via the meta robots tag, because the two directives operate at incompatible stages of the crawl-index pipeline. If robots.txt blocks the page from being fetched, crawlers never read the page at all and therefore never see the noindex meta tag in its head section. The page may still appear in search results as a URL-only result with no title or description if it has any inbound links from elsewhere on the web, because Google can include URLs in its index based on link references even when it has never successfully crawled the destination. For pages you want completely removed from search results, follow the correct sequence: first ensure the page is crawlable and not blocked in robots.txt, second add the noindex meta robots tag, third wait for Google to recrawl and process the directive, and only after noindex has been confirmed in Search Console can you optionally add a robots.txt block for crawl efficiency.
Combining directives correctly inside a single meta robots tag is also a frequent source of subtle bugs that depress site performance for months before anyone notices. The directives are comma-separated inside the content attribute, for example content noindex, nofollow or content noindex, follow, and the order does not affect interpretation. However certain combinations create logical conflicts that confuse search engines and produce unpredictable results. Combining noindex with a canonical tag on the same page tells Google simultaneously not to index the page and to consolidate ranking signals onto another URL, which is contradictory because a noindex page has no ranking signals to consolidate. Combining noindex with hreflang declarations sends similarly mixed messages about whether the page exists as a translation target. Combining nofollow with internal navigation links accidentally blocks ranking authority flow through your own site. Audit your meta robots implementations alongside your canonical, hreflang, and internal linking strategy to catch these conflicts before they affect ranking quality.
Select the directives you need and the generator will produce the correctly formatted meta robots tag HTML.
Step-by-step guide to meta robots tag generator:
Choose your directives
Select from the available directives based on what you want each crawler to do with the page. Index or noindex controls whether the page appears in search results. Follow or nofollow controls whether ranking signals pass through the links on the page. Noarchive prevents the cached version from being shown. Nosnippet blocks the description snippet from appearing alongside the URL. Max-snippet, max-image-preview, and max-video-preview offer fine-grained display controls for premium or metered content.
Select the target bot
Choose robots for the default rule that applies to every compliant crawler across the web, which is the right choice for the vast majority of meta robots implementations. Choose googlebot to set a Google-specific directive that overrides the generic robots rule on that page for Google crawlers only. Choose bingbot for a Bing-specific directive. You can include multiple meta robots tags on the same page with different bot targets when you need different behaviour per crawler, although most sites get by with a single default robots tag.
Generate the tag
Click Generate to produce the correctly formatted meta robots tag HTML using the standard meta name and content attribute syntax expected by every major search engine. The generator handles directive ordering, comma separation, and escaping for you, eliminating the manual typos that frequently cause robots directives to fail silently. Copy the resulting tag block, which is ready to paste into any HTML page without modification regardless of which CMS or framework powers the site.
Add to your page head
Paste the tag into the head section of every page where the directive should apply, placing it near the top of the head before any large script blocks so it is parsed early by crawlers that may abort processing on heavy pages. Confirm the tag is present by viewing the page source after deploying, ideally using Search Console's URL Inspection tool which shows exactly how Googlebot reads the page including the meta robots directive it extracts. Monitor the Coverage report over subsequent recrawl cycles to verify Google is respecting the directive as intended.
Common situations where this approach makes a real difference:
Staging site protection
A developer spinning up a staging site on a public subdomain of the live production domain adds noindex meta robots tags to every page on the staging environment before pointing the DNS record at the new server, preventing staging content from appearing in search results during the testing window. The team also adds HTTP basic authentication as a belt-and-braces measure, but the noindex tag remains the primary defence because authentication can be temporarily disabled for client review sessions and the noindex continues protecting the environment from accidental indexing. Once the production launch is complete, the noindex tags are removed from the production deployment so the live pages can rank, while the staging environment retains them indefinitely.
Thin content exclusion
An e-commerce site running a Magento installation discovers via a Screaming Frog crawl that hundreds of automatically generated filtered category pages with little unique content beyond a filter parameter are being indexed alongside the main category pages, splitting ranking authority and competing against the canonical category URLs in search results. The SEO team adds noindex meta robots tags to every filter parameter combination via a template-level change, while keeping the canonical tags pointing to the main category as a complementary signal. Over the following indexing cycles Google drops the thin variants from search results and concentrates ranking authority onto the main category pages, which subsequently climb measurably for their target queries.
User account pages
A SaaS platform adds noindex, nofollow meta robots tags to every user dashboard, account settings page, billing page, and internal application route to prevent private user content from being indexed by accident and to stop search engines from following any links on those pages back into authenticated areas. The combination of noindex and nofollow ensures these pages contribute no ranking signals to public search and pass no equity through their internal links, which is exactly the desired behaviour for authenticated application surfaces that should never appear in any search context regardless of how they are linked elsewhere on the web or from internal navigation paths.
Use this when you need to prevent specific pages from appearing in search results, stop link equity flowing through certain pages, or control how snippets and cached versions of pages appear in Google.
Get better results with these expert suggestions:
Never block noindex pages in robots.txt simultaneously
This is the single most common meta robots implementation error and it produces exactly the opposite outcome from what teams intend when they apply both controls. If robots.txt blocks a URL from being crawled, Google never fetches the page and therefore never reads its noindex tag, leaving the URL potentially indexable as a title-less search result if it has any inbound links anywhere on the web. Always allow crawlers to access pages you want noindexed so they can fetch the page, read the directive, and respect it. Use robots.txt blocks only for pages where crawling itself is wasteful and you do not need the noindex layer.
Use noindex on filtered e-commerce pages
Product category pages with filter parameters like color=red, size=L, or sort=price_asc create dozens or hundreds of near-duplicate URLs that compete against each other and against the main category page for the same ranking signals. Adding noindex to every filtered variant while keeping canonical tags pointing to the main category page concentrates your indexing budget and ranking authority on the main category URL without splitting it across hundreds of thin variants. The combined noindex plus canonical pattern is one of the highest-leverage technical SEO wins available on any e-commerce site running faceted navigation.
Add noindex to thank-you and confirmation pages
Post-conversion pages including order confirmations, form thank-you pages, account setup completion screens, password reset confirmations, and similar acknowledgement pages should always carry noindex meta robots tags. These pages have no search ranking value because they only make sense in the context of an immediately preceding action, and they create a poor user experience when they appear in search results as out-of-context entry points into checkout or account flows. Implement the noindex via a template-level change so every page of this type inherits the directive automatically without depending on per-page manual configuration that inevitably drifts.
Monitor noindex pages in Search Console
Google Search Console's Pages report includes an Excluded by noindex tag section listing every page Google has discovered but respects as noindex according to the directive in your page head. Review this list quarterly to confirm only intended pages appear in the excluded set, and investigate any unexpected entries promptly because finding important content pages in this list almost always indicates a noindex tag was applied accidentally through a template misconfiguration, a CMS bug, or an SEO plugin setting that nobody documented. Catching these errors quickly limits the traffic damage.
Do not use noindex and canonical together on the same page
Adding a canonical tag to a page while also marking it noindex creates a logical conflict. If you don't want a page indexed, use noindex. If you want it indexed but under a different URL, use canonical without noindex.
Use noindex for thank-you and confirmation pages
Post-conversion pages (order confirmations, form thank-you pages) should be marked noindex to prevent them from ranking in search and showing as entry points to a checkout flow with no context.
Prefer robots.txt for blocking entire sections
Meta robots tags work at the page level. If you want to block an entire directory (e.g., /admin/ or /staging/), use a robots.txt disallow rule instead of adding noindex tags to hundreds of individual pages.
More use-case guides for the same tool:
Open the full Meta Tags — free, no account needed, works on any device.
Open Meta Tags →Free · No account needed · Works on any device