Most popular variants of the header value (we only show this when there's just a bunch of variants):

Controls the behavior of search engine bots and may contain most of the directives usually found in robots.txt file.


We have seen 2247 websites setting the X-Robots-Tag HTTP header and 65 unique values of this header.