WebCookies logo Web Cookies Scanner

All-in-one free web application security tool. Web application vulnerability and privacy scanner with support for HTTP cookies, Flash, HTML5 localStorage, sessionStorage, CANVAS, Supercookies, Evercookies. Includes a free SSL/TLS, HTML and HTTP vulnerability scanner and URL malware scanner.

Websites setting X-Robots-Tag HTTP header

Values

Most popular variants of the header value (we only show this when there's just a bunch of variants):

Controls the behavior of search engine bots and may contain most of the directives usually found in robots.txt file.

Reference...

We have seen 2247 websites setting the X-Robots-Tag HTTP header and 65 unique values of this header.