Batch Noindex Meta & Header Checker
Verify if web pages are hidden from search engines via X-Robots-Tag headers or <meta name="robots" content="noindex"> tags.
Want a full-site indexability & technical audit?
Detecting noindex tags is just one part of technical SEO. Run a full SearchVitals audit to analyze page speed, canonical tags, structured data, and broken links across your entire domain.
Start Free Website Audit arrow_forwardHow Noindex Detection Works
Search engines check two distinct places for indexing directives. This tool inspects both simultaneously.
1. HTTP Response Header (X-Robots-Tag)
Server-level header directive sent before any HTML content is rendered. Commonly used for non-HTML files (PDFs, images) or global web application routes (e.g. X-Robots-Tag: noindex, nofollow).
Content-Type: text/html
X-Robots-Tag: noindex
2. HTML Meta Robots Tag
HTML element placed in the page <head> block instructing crawlers like Googlebot, Bingbot, or Baiduspider not to index the specific page.
<meta name="robots" content="noindex, follow">
</head>
help Frequently Asked Questions
What is the difference between HTML meta noindex and HTTP X-Robots-Tag?
The HTML <meta name="robots" content="noindex"> tag works inside HTML documents. The HTTP response header X-Robots-Tag: noindex works for non-HTML files like PDFs, images, and API responses as well as web pages.
Why are my pages dropped from Google index despite no meta tag?
A common hidden cause is an X-Robots-Tag: noindex HTTP header sent by web servers (Nginx, Apache) or CDN middleware (Cloudflare). This checker detects both sources simultaneously.