Since the beginning of 2024, the demand for the content created by the Wikimedia volunteer community – especially for the 144 million images, videos, and other files on Wikimedia Commons – has grow…
Apparently the dump doesn’t include media, though there’s ongoing discussion within wikimedia about changing that. It also seems likely to me that AI scrapers don’t care about externalizing costs onto others if it might mean a competitive advantage (e.g. most recent data, not having to spend time and resources developing dedicated ingestion systems for specific sites).
I want to stress this: it’s not that “tech bros” are just stupid—even though a lot of them are revoltingly unappreciative of the giants whose sholders they stand on—it’s that they don’t care.
Apparently the dump doesn’t include media, though there’s ongoing discussion within wikimedia about changing that. It also seems likely to me that AI scrapers don’t care about externalizing costs onto others if it might mean a competitive advantage (e.g. most recent data, not having to spend time and resources developing dedicated ingestion systems for specific sites).
I want to stress this: it’s not that “tech bros” are just stupid—even though a lot of them are revoltingly unappreciative of the giants whose sholders they stand on—it’s that they don’t care.