Doubao potentail AI bot disallow rule.
https://bytedance.com
Robots.txt · AI Bot
Get access to data on 1,065,897 websites that are ByteDance Bytespider Disallow Customers. We know of 725,293 live websites using ByteDance Bytespider Disallow and an additional 340,604 sites that used ByteDance Bytespider Disallow historically and 250,430 websites in the United States.
Get a list of 1,065,897 websites using ByteDance Bytespider Disallow which includes location information, hosting data, contact details, 725,293 currently live websites and an additional 503,235 domains that redirect to sites in this list. 340,604 sites that used this technology previouslyand 250,430 websites in the United States currently using ByteDance Bytespider Disallow.
Countries
Financial
Group
Region