robots.txt Usage Statistics

robots.txt DistributionDistribution of the top web technologies.

Please upgrade your flash player

Distribution is calculated from a cross section of website domains provided by URLs entered at BuiltWith.com and the Quantcast Top Million. Last calculated on September 01 2010

Trends UpdatesTrends Email Updates

Do you want to be updated on the latest changes in web technology usage? We send an occasional email with updates on web technology usage. See an example update.

Top Providers

Not Listed? Search for Technology

Hot ProvidersBiggest Movers in robots.txt

None yet

Website OptimizationOptimize. Track. Compete.

Apply this information and improve your websites Search Engine Optimization, Web Technologies and Document Standards with the BuiltWith Website Optimizer. Signup for a Free SEO and Technology Report.

robots.txt Usage Statistics

Web and Internet Technology Usage Statistics