In a debate likely to get louder as AI agent usage grows, some people say Perplexity crawling blocked websites isn't a simple matter.
When Cloudflare accused AI search engine Perplexity of stealthily scraping websites on Monday, while ignoring a site’s specific methods to block it, this wasn’t a clear-cut case of an AI web crawler gone wild.
Many people came to Perplexity’s defense... [6081 chars]