Web giant Cloudflare to block AI bots from scraping content by default

  • Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow or block AI crawlers. At least 16% of the world's internet traffic gets routed through Cloudflare, one of the world's largest content delivery networks.