Noindex Simple Bookmark Icon

A noindex tag is a page-specific directive instructing search engines not to index the URL. Noindex directives can appear in a URL's section (called a noindex meta tag) or in the HTTP response header (called a robots noindex tag or X-Robots-Tag).

Last Updated November 13, 2023
Purple to white gradient footer header design

Noindex tags provide the flexibility you need when managing multiple marketing channels, from search and paid to social and email. With noindex directives, you can optimize your search engine optimization (SEO) strategy by excluding non-SEO pages from appearing in organic search results.

Learn more about the meaning, benefits, use cases, and setup of noindex tags below!

What is a noindex tag?

A noindex tag is a <meta> tag or robots directive instructing search engines not to index an HTML or non-HTML resources, like PDF, image, or video files. Common use cases for noindex tags include landing pages and downloadable resources.

What is the difference between a noindex meta tag vs. robots noindex tag?

The difference between a noindex meta tag and a robots noindex tag is the installation and use cases:

Installation

  • A noindex meta tag is installed in a URL’s <head> section, typically by an SEO.
  • A robots noindex tag is installed in the HTTP header, typically by a web developer.

Use cases

  • A noindex meta tag is used for HTML resources.
  • A robots noindex tag is used for non-HTML resources.

Appearance
A noindex meta tag appears as follows:

<!DOCTYPE html>

<html lang="en">

<head>

    <meta charset="UTF-8">

    <meta name="viewport" content="width=device-width, initial-scale=1.0">

    <meta name="robots" content="noindex, follow">

    <title>Your Page Title</title>

</head>

<body>

    <!-- Your page content goes here -->

</body>

</html>

A robots noindex tag appears as follows:

HTTP/1.1 200 OK

Date: Wed, 13 Oct 2023 00:00:00 GMT

Server: Your Server

X-Robots-Tag: noindex, follow

Content-Type: text/html; charset=utf-8

Content-Length: xxx

<!-- Your page content goes here -->

If you’re uncertain about which noindex directive you should use, look at what you’re looking to block from indexing. For HTML files, like a paid landing page, you’ll use a noindex meta tag. In comparison, for PDF, image, or video files, you’ll use a robots noindex tag.

Why is a noindex tag important in SEO?

A noindex tag is important in SEO because it allows you to manage your search visibility, like for:

  • Landing pages, like for an ad or email campaign
  • Thank you pages, like for a contact or ordering form
  • Downloadable resources, like a PDF

Typically, you wouldn’t want these pages to appear in search results because they’re intended for a different purpose. For example, none are optimized for search, and some (like a thank you page) wouldn’t offer anything valuable to users searching on the Internet.

When should I use a noindex meta tag?

Besides using a noindex meta tag for HTML resources (you’d use a robots noindex tag for non-HTML resources), you’ll also use a noindex meta tag based on factors unique to your site and digital marketing strategy.

Some common page types for using a noindex tag include the following:

  • Landing page
  • A/B testing page
  • Thank you or contact confirm pages
  • Paginated pages
  • Archive pages

While specific to SEO, noindex tags are a team effort. Collaboration is critical to learning about new pages, like a new landing page for pay-per-click (PPC), or resources, like a downloadable resource for driving email opt-ins via email marketing services, that shouldn’t get indexed by Google.

How do I set up a noindex tag?

Setting up a noindex tag starts with identifying which tag you’ll use:

How to set up a noindex meta tag

Learn how to set up a noindex meta tag (which is for HTML resources) below:

  1. Open the URL’s HTML file
  2. Add one of the following meta tags in the <head> section:
    1. To allow search engines to follow the URL’s links, use <meta name="robots" content="noindex, follow">
    2. To prevent search engines from following the URL’s links, use <meta name="robots" content="noindex, nofollow">
  3. Save and upload the HTML file

If you use a content management system (CMS) like WordPress and a popular SEO plugin like Yoast SEO, you can add a noindex meta tag without using HTML. Just follow these steps:

  1. Open the URL’s editor
  2. Open the Yoast toolbar
  3. Click “Advanced”
  4. Select “No” from the dropdown menu labeled, “Allow search engines to show this Post in search results?”
  5. Click “Update” to save your changes

You can verify your work by visiting the URL and viewing its page source (use the shortcut Ctrl+U in Google Chrome). You can then search for “noindex” to see your noindex tag, which should appear near the top of the page in your <head> tag.

How to set up a robots noindex tag

Learn how to set up a robots noindex tag (which is for non-HTML resources) below:

  1. Open the site’s .htaccess file
  2. Add one of the following directives:
    1. To allow search engines to follow the URL’s links, use X-Robots-Tag: noindex, follow
    2. To prevent search engines from following the URL’s links, use X-Robots-Tag: noindex, nofollow
  3. Save and upload the file

In most cases, you’ll need to work with a web developer to implement a robots noindex tag.

5 best practices for your SEO noindex tags

While adding noindex tags to your website’s content is easy, noindex tags carry immense power in search engine optimization because they stop search engines from indexing content. That’s why it’s vital to review these best practices for SEO noindex tags:

1. Ask for help

If you’re unsure about implementing a noindex tag, ask for help. For example, if you’ve never worked with your site’s .htaccess file and need to set up a robots noindex tag, ask your web developer for assistance, whether to implement the tag or give a walkthrough.

2. Review search engine documentation

Following search engines and their changing documentation will keep you informed on their noindex tag policies. Google, for example, shared that even if you use “noindex, follow” in your noindex meta tag, Google will eventually stop following the links on the URL.

3. Test noindex implementations

Google provides a free, built-in tool in Google Search Console for testing your noindex tags. Use the URL Inspection Tool in Google Search Console to see if Google’s crawlers saw the noindex directive when crawling the URL.

noindex testing in Google Search Console

4. Request search engines to recrawl new noindex content

If you’ve currently applied the noindex tag to content in a search engine’s index, request a recrawl. You can do this from the URL Inspection tool in Google Search Console. By recrawling your content, Google can discover your noindex tag.

5. Use canonical tags for duplicate content

While some SEOs recommend using noindex tags for duplicate content, it’s better to use canonical tags. A canonical tag explains to search engines which URL should rank, so if URL A’s canonical tag references URL B, Google knows its URL B that should get served in search results, not URL A.

Optimize your indexation with SEO experts

Indexation is critical to search engine optimization, which is why noindex tags are a vital part of learning SEO. If you want to continue building your SEO knowledge, browse our blog to read our SEO expert’s latest advice, tips, and tricks!

Don’t fail your website’s most important test

Get an SEO scorecard of your website for free in less than 30 seconds.