Doubao potentail AI bot disallow rule.
https://bytedance.com
Robots.txt · AI Bot
Get access to data on 1,114,886 websites that are ByteDance Bytespider Disallow Customers. We know of 734,933 live websites using ByteDance Bytespider Disallow and an additional 379,953 sites that used ByteDance Bytespider Disallow historically and 259,835 websites in the United States.
Get a list of 1,114,886 websites using ByteDance Bytespider Disallow which includes location information, hosting data, contact details, 734,933 currently live websites and an additional 510,497 domains that redirect to sites in this list. 379,953 sites that used this technology previouslyand 259,835 websites in the United States currently using ByteDance Bytespider Disallow.
Countries
Financial
Group
Region