A robots disallow all directive with no other options.
https://robotstxt.org
Robots.txt
Get access to data on 11,594,986 websites Robots Disallow Customers. We know of 4,891,383 live websites using Robots Disallow and an additional 6,703,603 sites that used Robots Disallow historically and 1,710,534 websites in the United States.
Get a list of 11,594,986 websites using Robots Disallow which includes location information, hosting data, contact details, 4,891,383 currently live websites and an additional 2,420,109 domains that redirect to sites in this list. 6,703,603 sites that used this technology previouslyand 1,710,534 websites in the United States currently using Robots Disallow.
Countries
Financial
Group
Region