of Robots.txt in the Top 1 Million Sites. Last updated 12th Sep 2023.
Robots Disallow is currently the most popular technology in this category.