generatingfail
generatingfail
Generating Fail
31 posts
This Tumblr catalogs examples of generative AI making an absolute fool of itself.
Don't wanna be here? Send us removal request.
generatingfail · 2 hours ago
Text
A useful tool to discover whether you've been plagiarized by generative-AI chuds.
Alright! Sorry for being so absent today! I was building a tool so you can all check your own names on demand.
I am asking that you not talk about it on Hugging Face. I'm sure word will get there eventually, but I'd like to avoid them accessing this as much as possible. Feel absolutely free to spread around Tumblr.
Tool is here! Use page 1 to search by username. Use page 2 to search by work ID (which you'll need to do if you're looking for an anonymous work).
That said, I did pay out of pocket for some of the accounts I've needed to do all this. If I need to, I'm fine with eating that cost, but I am going to ask nicely that if you feel like kicking in toward it, you donate to the Ko-Fi I made specifically for this technical project. I was hoping to get a short-term membership, but I was only able to buy access to host this for a full year lmao. BUT regardless, this is freely available to everyone. Do NOT feel like you need to donate if it'll put you in a bad place or even if you just don't want to. Just figured I'd ask instead of quietly sucking up the $180.
Thanks to everyone who helped with the cost to host the tool! I appreciate you so so so much. As of this edit, I'm at $185 total, and right now, I don't expect to have to pay for anything else to keep this available.
I gave the tool a quick test, but please come yell if it stops working. I'm around; I'll fix as fast as I can. It's slow as hell, but it does load eventually. Give it up to 10 minutes, and if it seems down after that, please alert me via ask! Anons are on.
Now with all that being said, time for me to start focusing on how we stop the next scrape.
1K notes · View notes
generatingfail · 1 day ago
Text
So, let me get this straight. The leadership at Seattle's Worldcon, a SFF fan convention that is also hugely important to working creators:
used a chatbot service widely excoriated by working creators because it plagiarizes them and openly competes with their labor...
... to vet potential panelists, when its parent corporation is defending defamation lawsuits because it allegedly emits damaging lies about people...
... not to mention the service is demonstrably biased, in an area of publishing that absolutely doesn't need any more bias...
... without telling anyone.
Heckuva job, Kathy. Let's see if you manage to do as much damage to the Hugos as the Puppies did. Looks like it'll be a close race.
Additional commentary at Pivot to AI.
2 notes · View notes
generatingfail · 2 days ago
Text
AI "summarizer" makes total hash of science, film at 11.
0 notes
generatingfail · 4 days ago
Text
Recent generative-AI fail
Tumblr media
Examples of fail that have crossed my radar recently:
Google AI engineer uses generative AI to "help" write a paper. Result: fail.
Right-wing conspiracy theorist Mike "My Pillow" Lindell's lawyers use generative AI to write a legal brief. Result: fail. (As a proud Wisconsinite, I'd love to see DeMaster disbarred over this.)
Using "vibe coding" creates security fails, even if you ask the generative AI pretty pretty please not to write vulnerabilities.
11 notes · View notes
generatingfail · 6 days ago
Text
Sometimes AI fail is funny.
Sometimes it's fatal.
Never, ever trust AI with your life. Not EVER.
Tumblr media
For those not in the know, this is one of the Amanita mushrooms referred to as a Destroying Angel. Never, ever, ever, ever forage with an app. Especially for mushrooms.
135K notes · View notes
generatingfail · 7 days ago
Text
Cannot be said often enough.
I have been made aware that this is not common knowledge and so wanted to announce that ChatGPT is not a search engine and not supposed to know answers to things. It's a language model- it's trained to talk like a person. Not to know information or understand how to do operations or really even reasoning
6K notes · View notes
generatingfail · 14 days ago
Text
I DON'T KNOW BUT I BEEN TOLD
DEFEAT AI WITH CARDBOARD FOLDS
Tumblr media
This screams clones to me
6K notes · View notes
generatingfail · 14 days ago
Text
generative AI literally makes me feel like a boomer. people start talking about how it can be good to help you brainstorm ideas and i’m like oh you’re letting a computer do the hard work and thinking for you???
46K notes · View notes
generatingfail · 15 days ago
Text
Yep. AI agents are gonna be greeeeeeeeeeeeeat.
Tumblr media
C A N E N D A R
25K notes · View notes
generatingfail · 19 days ago
Text
Whatevs.
Hey, Tumblr?
What the fuck is this ad?
Tumblr media
Thoughts?
98 notes · View notes
generatingfail · 20 days ago
Text
Oh, look, just what we needed: more software supply-chain vulnerabilities!
“Slopsquatting” in a nutshell:
1. LLM-generated code tries to run code from online software packages. Which is normal, that’s how you get math packages and stuff but
2. The packages don’t exist. Which would normally cause an error but
3. Nefarious people have made malware under the package names that LLMs make up most often. So
4. Now the LLM code points to malware.
https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/
8K notes · View notes
generatingfail · 20 days ago
Text
nothing funnier to me than when AI does math wrong. like I get why it happens, it's a language model that's treating the numbers you feed it as words rather than integers and then giving you an answer based on how those words typically appear in a block of text instead of actually performing a calculation. but the one thing computers are genuinely incredible at. you fucked up a perfectly good calculator is what you did, look at it it's got hallucinations
90K notes · View notes
generatingfail · 21 days ago
Text
We have an AI now! There's an AI! There's AI! It'll do that for you. It can do that for you in a worse way! We have AI now! AI chat bot, we got it! It can know all your information and make an AI response! Is it safe? Is it safe? We don't know. We laid off the workers focused on the safety. They were making it take longer. They were making it take longer than the 2 weeks we spent slapping this together to get our nose out ahead in the rat race. Investors love AI. Investors love when we say "Customers love AI!" Please love it. Please say you love it. It's fine if you don't. We're telling the investors you said you love it. We love it. Our whole company loves it. We laid off everyone who's been at the company for longer than 7 years. They can use AI to write their job applications. We laid off everyone who's been here longer than 5 years. This is such a company #moment 🤗. Our AI can do that for you.
6K notes · View notes
generatingfail · 22 days ago
Text
Gosh. Who could possibly have imagined.
(Anyone paying attention, that's who.)
1 note · View note
generatingfail · 24 days ago
Text
Perfect deconstruction, no notes. Thank you!
That ChatGPT ask about The Great Famine made me think about how generative AI is so devastating for historical understanding, but especially the understanding of dress history. There's a lot of completely inaccurate history AI slop, both generated images and writing. I'm always searching primary source images, but even then I've started to come across the occasional AI generated image, which is always very bad. Google image search is at this point almost useless.
The issue is that there's so much outdated information and frankly misinformation about history in the internet and in other source materials the AI scraps. This is of course an issue with many other fields as well, but history definitely belong to the fields which have most misinformation spread about them. When a human armed with a bit of critical thinking comes across a source they can evaluate it's validity. But AI doesn't have critical thinking. It can't think. So if there's a lot of sources, which peddle the same common misconception, AI weights it above what the few rigorous academic sources say. And then the AI becomes basically a misinformation peddling machine. And there's no way of finding our where it got it's information. Even the AI doesn't really know because of the way it works, and that's why, when you try to ask it, it tries to scours for sources that say similar things it was saying rather than giving the actual source it got the information from. And if it doesn't find a source? Well, it might hallucinate one. This is of course an issue in multiple level not just because it's filling the internet with misinformation and drowning out reliable information. It's also basically a plagiarism machine.
This is even worse with dress history than most historical fields, because dress history is such a new field and there's comparatively very little quality research. Even many historians of different fields peddle a lot of old misconceptions of dress history (sometimes you even come across a fairly new paper on dress history and there's some misconception repeated as a truth). So of course AI is very unlikely to produce anything close to accurate information on dress history.
So to see for myself how bad it actually is (and to have a bit of laugh) I decided to try out ChatGPT for the first time. I decided I would ask it a question I have answered in a blog post myself before to see how close (or far) it got.
Here's what I asked: "When did it become socially acceptable for men to wear dresses?"
I have written a very long post on this before found here.
And here's the answer ChatGPT gave with my commentary:
The idea of men wearing dresses has evolved significantly over time, with different periods in history showcasing varying degrees of acceptance. In general, men have worn clothing that could be considered "dress-like" at various points in history, though the specific social context has changed. 1. Ancient and Medieval Times: Men in many ancient cultures, including the Greeks, Romans, and Egyptians, wore tunics, robes, or other garments that we might now think of as dresses. These were considered appropriate for men, often signifying social status, wealth, or ceremonial importance.
Not bad, though this makes it sound like men only wore dresses to signify status, wealth or ceremonial importance, when in fact all men wore dresses. I also made a point in my post to say these were dresses, not just "dress-like". They were (mostly) constructed and (mostly) called the same as the equivalent clothing women wore, so of course I take issue with the framing.
2. Renaissance and Early Modern Period: During the Renaissance and up through the 17th century, men’s fashion included elaborate gowns, skirts, and dresses, often with frills, lace, and rich fabrics. These were considered fashionable and elegant for men, particularly among the aristocracy.
Here's were we're getting to the inaccurate territory. Yes still during renaissance men were wearing dresses, however it was becoming fashionable among especially young noble (and soldier class) men to wear extremely tiny skirts, until they stopped being skirts and turned into very fitted thighs (hose) and doublet. It was the period when dress became increasingly less acceptable for men to wear, but it was precisely lower class and peasant men, who were slower to follow the new fashions and masculine standards, not very surprisingly. But by Early Modern Period it had become unacceptable for men to wear dresses. Yes, there was still hems at points, but those were coat hems, which might seem like basically the same as a skirt hem, but conceptually they were different. It's the same today. No one thinks nothing of it if a man is wearing a long overcoat, with buttons closed, on top of a suit, but if they are wearing thighs and same length skirt? Well, for the next couple of weeks you'll gate outrage op-eds and conservative influencers losing their minds over "the death of Western civilization".
Also in 1600s (roughly around 1630s-1660s) rich fabrics and elaborated detailing was not fashionable, not among women and certainly not among men. Men's fashion especially favoured a lot of black and other dark and neutral tones, influenced by somber religious atmosphere influenced by the all the Reformations and Counter-Reformations and wars about them going on at the time. (Of course there's some counter examples, but the general statement ChatGPT gave to me is simple incorrect.)
3. 18th and 19th Century: By the 18th century, Western fashion for men became more structured, and by the Victorian era (19th century), men were expected to wear trousers, waistcoats, and suits (my comment: you mean coat right, ChatGPT?? suit already encompases trousers and waistcoat). The shift towards more gender-specific clothing for men and women took root, and women’s dresses became more ornate and feminine, while men’s clothing became more utilitarian and restrictive.
First of all the height of structuring in Western fashion for both men and women, was during the Elizabethan Era, and additionally men's fashion got briefly a little less structured during the 18th century. As I explain in my post about the actual origins of modern men's suit (it was not Beau Brummel), the three piece suit with trousers, waistcoat and coat was popularized in 1670s. Women's dresses becoming more "feminine" means literally nothing when what was feminine was just seen differently. Of course it became more feminine in our modern eyes, when we get closer to the present day in the historical timeline, because modern femininity was being formed at the time. Men's fashion did become more utilitarian (I talk about a bit about the reasons why in the post about three piece suit above), but I wouldn't call it more restrictive necessarily.
Points for ChatGPT though for acknowledging that fashion became more gender specific around 18th and 19th centuries.
4. 20th Century: The 20th century saw men in dresses or skirts make occasional appearances in fashion, especially in avant-garde or countercultural movements. For example, in the 1920s, some male actors in Hollywood (my comment: here it's "forgetting" where it's going with the sentence, because it doesn't understand what a cohesive sentence means), such as Marlene Dietrich’s famous cross-dressing moments, challenged gender norms. In the 1960s and 1970s, figures like David Bowie, with his androgynous style, brought more attention to the concept of men wearing dresses as part of a wider push for gender fluidity in fashion.
The fact that cross-dressing became more acceptable in the early 20th century for women and people seen as women, didn't really do anything (or very little) to the make cross-dressing more acceptable for men, or those seen as such. Counter culture fashions in 70s and 80s were much more accepting of androgynous men and men wearing skirts, but the wider mainstream fashion was absolutely not accepting of that, definitely not outside the rock icons, who themselves were also side-eyed a lot.
5. Late 20th to 21st Century: By the 1990s and 2000s, with the rise of gender nonconformity and movements pushing for gender equality and expression, men wearing dresses became more visible and socially accepted. Public figures like Prince, Kurt Cobain, and later, celebrities like Harry Styles and Billy Porter, have worn dresses and skirts as part of their personal style, pushing the boundaries of traditional gendered fashion.
It's absolutely still not seen as acceptable for men to wear dresses. Yes, couple of celebrities have done that, and yes there's alternative fashion and queer people who do that, but if you take a look at how people in legacy and social media talk about them, it's pretty obvious that's not socially acceptable in the mainstream.
In essence, it became more socially acceptable for men to wear dresses as part of a broader cultural shift toward embracing non-binary gender expression and rejecting rigid gender norms, especially in the 21st century. Celebrities, designers, and activists have played key roles in challenging the old norms, making fashion more inclusive and fluid. This acceptance continues to grow in many parts of the world, although social attitudes can still vary greatly depending on cultural context.
"A broader cultural shift toward embracing non-binary gender expression and rejecting rigid gender norms." Laughing crying. Yeah, there was a cultural shift, but clearly it was not super broad. It's really laughable to suggest in the heart of the reactionary backlash moment that it's somehow broadly socially acceptable for men to wear dresses.
Also this "although social attitudes can still vary greatly depending on cultural context" makes it sound like outside the western context, which this answer is all about, the attitudes haven't changes as much, when in fact outside the western context dresses for men are much more often acceptable and part of the cultural norms.
Perhaps it was unfair of me to ask my question in a misleading way, since the answer to "when did it become acceptable for men to wear dresses" is "it was for a very long time, but it's not anymore". But this is part of the issue with ChatGPT and similar text based AI. When you ask them a question they will take the assumptions of the question and run with them, even if the assumptions in the question are completely false. For example if you would ask ChatGPT "why were corsets unhealthy?" it might answer with a very long answer full of pseudoscientific misinformation straight from the mouths of Victorian eugenists. I did that and the answer was extremely predictably. I'm not going to go through all that since is was so very long and this is getting long enough, but for a taste, after all the bullshit reasons it gave, here's what it wrote at the end:
Why Corsets Were Worn Despite Health Risks: Fashion and Aesthetic Appeal: Corsets were primarily worn to achieve a specific beauty standard that emphasized an extremely small waist and a curvy figure. This was considered a symbol of femininity, refinement, and social status during certain historical periods. Cultural Norms: The societal pressure to conform to the idealized figure meant many women endured discomfort and health risks to fit into the norms of the time.
The biggest eyeroll. Of course nothing about how it distributes the weight of the boobs much more comfortably in the waist rather than the shoulders, or how the heavy dresses people wore needed support or movement would have been very difficult, or how it was an easy way to alter the body, any kind of body, to the fashionable silhouette without needing any invasive procedures or dangerous diets. The most classic, most predictable corset misinformation. This is exactly what I meant at the beginning. The internet is so full of this bullshit already, in the AI algorithm it makes it true.
The lesson is: do not use ChatCPT as your search engine and don't trust it as your source of information. There is numerous of issues with generative AI and the spread of misinformation is certainly one of the biggest, seeing how much death and destruction misinformation has caused only with vanilla social media. I'm afraid to think about the repercussions of refining that metaphorical misinformation machine with the literal misinformation machine. If you want to do research into dress history yourself, but don't know where to start, rather than asking ChatGPT, here's my tips for where to start.
Also be skeptical of the sources you find in the internet, including everything I write. In the age of generative AI it's even more important to use proper sourcing. I'm definitely not perfect about this, since I'm extremely chaotic in my research most of the time and bad at keeping my sources in good order (I don't want to do boring stuff when researching for my hobby, I do that enough for uni), but I'm making an effort to be better about it, at least for my more structured posts. But if you want to know any sources I've used for any reason, when I haven't listed them, you're always free to ask. I might have it somewhere among my 500 open tabs still open, or I might still be able to find it again. So anyway, be skeptical of writings (again, including mine) which don't have sources listed, not just because it could be AI, but also because the same issues apply outside AI - it's much harder to evaluate how trustworthy the writing is or to know weather it's plagiarized.
281 notes · View notes
generatingfail · 25 days ago
Text
It's perilously easy to con people whose automation bias has become all-consuming. Just control the automation.
Tumblr media
5K notes · View notes
generatingfail · 27 days ago
Text
Analytical AI is hardly free of moral horrors; it fuels "the algorithm" that is destroying societies globally.
Analytical AI is extraordinarily good at noticing and then reifying patterns of bias.
I have been known to make data-science undergrads cry, because before I spoke to them they didn't know what their choice of study was responsible for. I'm NOT sorry.
But yes, generative AI is also fail.
Tumblr media
Vent art
110K notes · View notes