The Gentoo Linux project recently shuttered its Bugzilla instance due to severe traffic spikes attributed to aggressive AI scraping bots. The incident has sparked a heated debate on Hacker News regarding the "AI slop" era of the internet.
Commenters argue that the massive, indiscriminate scraping by AI companies to fuel LLM training data is effectively consuming the resources of volunteer-run projects. While some suggest technical defenses—such as traffic redirection, rate limiting, or even browser-based micropayments—others argue these measures add unsustainable complexity and gatekeeping to the open web.
The discussion highlights two conflicting perspectives:
1. **The Infrastructure Crisis:** Supporters of the site's closure argue that small-budget, volunteer projects are being "eaten alive" by automated crawlers, making it impossible to host dynamic content without expensive anti-bot infrastructure.
2. **The "Skill Issue" Argument:** Critics of the closure suggest that the problem is exaggerated, asserting that modern caching, static site generation, and standard CDN tools (like Cloudflare) should be sufficient to handle even high volumes of traffic.
Ultimately, the event serves as a microcosm of the growing friction between open information sharing and the resource-intensive, faceless demand for training data.