Doubao potentail AI bot disallow rule.
https://bytedance.com
Robots.txt · AI Bot
Get access to data on 1,142,012 websites that are ByteDance Bytespider Disallow Customers. We know of 673,782 live websites using ByteDance Bytespider Disallow and an additional 468,230 sites that used ByteDance Bytespider Disallow historically and 250,853 websites in the United States.
Get a list of 1,142,012 websites using ByteDance Bytespider Disallow which includes location information, hosting data, contact details, 673,782 currently live websites and an additional 500,386 domains that redirect to sites in this list. 468,230 sites that used this technology previouslyand 250,853 websites in the United States currently using ByteDance Bytespider Disallow.
Countries
Financial
Group
Region