of Robots.txt in the Top 1 Million Sites. Last updated 14th Jan 2024.
Robots Disallow is currently the most popular technology in this category.