Web Cookies Scanner

All-in-one free web application security tool. Web application vulnerability and privacy scanner with support for HTTP cookies, Flash, HTML5 localStorage, sessionStorage, CANVAS, Supercookies, Evercookies. Includes a free SSL/TLS, HTML and HTTP vulnerability scanner and URL malware scanner.

Controls the behavior of search engine bots and may contain most of the directives usually found in robots.txt file.

Value contains: Subtype: Subtype name:

We have seen 7573 websites setting the X-Robots-Tag HTTP header and 111 unique values of this header.

nationalpost.com noindex
mailjet.com index, follow
efirbet.com noindex
www.google.com noindex,nofollow
www.wp.pl noindex,nofollow
agrigentonotizie.it noindex, nofollow
namoffers.com noindex
kontaktlife.ru noindex
web-mastery.info noindex, nofollow
www.hln.be noindex
www.india.com noindex
www.tmz.com noindex
www.rtbf.be noindex, nofollow
www.bild.de noindex, nofollow
www.expressen.se noindex
www.spiegel.de noindex, nofollow, noarchive
www.repubblica.it noarchive
tvzap.kataweb.it noarchive
www.lastampa.it noindex, noarchive
www.panorama.it noindex
www.vanityfair.it noindex
sites.google.com noarchive
recipesforourdailybread.com noindex
fotostrana.ru noindex,nofollow
www.segodnya.ua noindex, nofollow