Research
Original measurements from the same engine that powers the monitor, published with the method, the raw dataset, and nothing behind a form.
- Invisible government: 106 .gov sites tell Google to stay out
One pass over all 16,935 registered .gov domains: 106 public homepages, from the Arizona Senate to hudhomestore.gov, tell Google not to index or crawl them.
2026-10-22 · stillindexed · dataset (CSV)
- Top 10,000 homepages: 14 apparent accidents
One HTTP pass over the Tranco top 10,000: 87 meta noindex homepages, 10 header noindex, 143 robots blocks, and 567 declared sitemaps that do not serve.
2026-09-03 · stillindexed · dataset (CSV)