#zero talk about the ethical implications of using AI in schools when they are based on scraped data

[enddaysengine]

Having the last 72 hours neck deep in a conference about GenAI in a school, while also having to try and fight for us to use anything other than ChromeBooks for staff and students - this is an incredibly good reason to be skeptical of the hype around AI and be even more skeptical of trusting ANY company with this much societal leverage ever again.

"A funny thing happened on the way to the enshittocene: Google – which astonished the world when it reinvented search, blowing Altavista and Yahoo out of the water with a search tool that seemed magic – suddenly turned into a pile of shit.

Google's search results are terrible. The top of the page is dominated by spam, scams, and ads. A surprising number of those ads are scams. Sometimes, these are high-stakes scams played out by well-resourced adversaries who stand to make a fortune by tricking Google[...]

Google operates one of the world's most consequential security system – The Algorithm (TM) – in total secrecy. We're not allowed to know how Google's ranking system works, what its criteria are, or even when it changes: "If we told you that, the spammers would win."

Well, they kept it a secret, and the spammers won anyway.

...

Some of the biggest, most powerful, most trusted publications in the world have a side-hustle in quietly producing SEO-friendly "10 Best ___________ of 2024" lists: Rolling Stone, Forbes, US News and Report, CNN, New York Magazine, CNN, CNET, Tom's Guide, and more.

Google literally has one job: to detect this kind of thing and crush it. The deal we made with Google was, "You monopolize search and use your monopoly rents to ensure that we never, ever try another search engine. In return, you will somehow distinguish between low-effort, useless nonsense and good information. You promised us that if you got to be the unelected, permanent overlord of all information access, you would 'organize the world's information and make it universally accessible and useful.'"

They broke the deal." -Cory Doctorow

Read the whole article: https://pluralistic.net/2024/02/21/im-feeling-unlucky/#not-up-to-the-task