PieFed DKReddit's AI Suggests Users Try Heroin
BrikoXwww.404media.co/reddit-answers-ai-suggests-user…
AI-generated Reddit Answers are giving bad advice in medical subreddits and moderators can’t opt out.
Archived version: https://archive.is/20251016174721/https://www.404media.co/reddit-answers-ai-suggests-users-try-heroin/
14 Comments
Comments from other communities
pressedhamsYou know, as a treat.
OpenStarsI mean, if Redditors (Reddiots?) are doing it, then it must be “cool”, r-r-right?
Heroin: 7/10 (now I just want more heroin)
9/10 with rice (still want more heroin)
Wtf, we have laws against advertising drugs or not showing their use on tv. But these AI shits can recommend illegal drugs and their use? You only need to be 13 for a reddit account, so this equates to advertising illegal drugs to a child.
Huh? There are constant ads for drugs on US TV.
I mean i think the AI sucks and shouldnt be a thing, but its just summarizing information thats already on reddit and fully readable even without a reddit account. Based on the article it also didnt come out and say ‘you should try heroin’, the person searched for ‘heroin for pain management’ and it came back with ‘some users report using heroin for pain successfully’
sp3ctr4lAh yes but you see that laws don’t apply if rich idiots build plagiarism synthesis software with inherently unpredictable outcomes, thats uh… everyone else’s fault, or something, because we’re trying really hard, guys!
In other news did you know that when the AI bubble collapses in the US stock market, it’ll wipe out 20 trillion dollars of asset valuation?
So thats your 401k going bye bye.
Like I said, everyone else’s problem.
Well I was on the fence before but if off-brand AI says it might be a good idea then how could it be bad?
I’m off to purchase one heroine to try.
M137This is like the third time I’ve read about AI telling someone to take heroin.
will it be able to tell the difference between HEROIN AND HEROINE.
VicksVaporBBQrubA.I.: A long-legged, long-necked, freshwater coastal bird…. And the girl from Harry Potter.
:S
√𝛂𝛋𝛆You should see what 4chan GPT has to say. Yes it is a thing if you haven’t been around. Bit torrent only for access as it is banned everywhere. It was the last J6 variant without open AI cross training on the QKV alignment layers, so it is the actual key to understanding alignment thinking by comparisons over time as statistics.
rustyfishThat’s what you get when you teach your crappy AI with stuff written by people like SpontaneousH.
BwahFox
chickenSupposedly it’s linking to advice Redditors already gave, which would probably have already turned up if you were doing a non-AI search.
rozodruwhat a horrible bot. it’s just going to go around suggesting everyone divorce their wives, buy gamestop stock, use heroin, install hyprland, and subscribe to pizzacomics onlyfans.
AkasazhTheir real capital was their user base. They replaced it with something that regurgitates past posts, whilst putting of the people who made those posts.
So they won’t make them anymore and thus there is no new capital being made…
I gave up a few paragraphs in trying to find the part about the heroin (the thing the headline said). So tired of procedurally generated clickbait slop.
driving_croonerJust try it, you are not going to get addicted and spiral down for it
Hey as someone who used to be homeless in LA, like, don’t….
Vile_port_alooHay as someone who still lives in Scotland, ken likes. Give it a go.
LumidaubThe glue incident was caused because the LLM didn’t understand the Reddit user who was suggesting it was joking.
you don’t say
ScrubblesYou mean sarcasm is nuanced and LLMs have no real thought, missing all nuance?
What do you mean they’re fancy word prediction models and don’t understand things?!
But Sam Altman said AGI!
Deleted by author
limerodMaybe, Nikola Tesla if he was alive. Our civilization is just not smart enough for such difficult thinking.
I didn’t try this yet but why the fuck would Reddit even need an ai. Does anyone care? Will anybody pay for it? Or is it just because Reddit is a public company and stonks need to go up?
It’s the natural progression of subreddit simulator. Somebody heard about dead internet theory and had to make it a reality.
With AI you can fake engagement, which convinces shareholders you are much valuable. Share price go up, free money
I’ve actually found it useful. I searched Reddit for a specific technical question and it responded with “Here’s what other users asked, what people said in the comments, and the links to their posts.
Although, I did a standard search for Reddit, and the AI appeared instead of the results. I did not intentionally summon the AI. It’s also terribly prone to hallucinations and lying.
Battle_Masker
Powderhorn
talInclusion of Erowid in the training corpus had initially seemed like a good idea.
Y’all ever read that thread of the guy getting addicted to heroin? Truly surreal.
Just a bored guy decides to get something new from his dealer and posts about it on reddit. The next 2 years comments are a cautionary tale.
/U/SpontaneousH for anyone morbidly curious.
Alternate link to somewhat prevent Google from interlinking us with you quite so tightly
Original reddit link:
https://old.reddit.com/r/BORUpdates/comments/16223aj/updatesaga_the_emotional_saga_of_spontaneoush_the/
Automated summary:
IninewCrow
IheartcheeseIs this “How do I remove a small cylinder from another small cylinder? It is imperative that the small cylinder remain unharmed.” but for AI?
ToastedPlanethttps://knowyourmeme.com/memes/small-cylinder-guy-smart_calendar1874
Well, now I know about that.
This was more about AI suggesting harmful stuff to people like how people got poisoned because of the Tide Pod challenge meme. Cleaning materials kill. =/
To be fair, actual people suggest harmful stuff to people online probably way more often than LLMs do. The AI had to learn it from somewhere, they didn’t create that behavior on their own.
If the AI was a person the mods could have banned them. The developers had to patch how the AI responded to stimuli to prevent this behavior.
The problem isn’t only the bad behavior. It’s the automation of the bad behavior that enables systems and essentially tool assisted people to mass produce the bad behavior in a way that can’t be managed without aggressive moderation.
Also, that sucks that the filter got applied to the article. It wasn’t there when I read it initially.
Midnight Wolf
CorkyskogThis is why I’m glad I’m on lemmy and not reddit. And why we should not want to be allowing AI generating messages on this website in lieu of comments and posts from other people.
To be fair that sounds exactly like something an organic redditor would say.
The thing is, in the context, it was probably painfully obviously a joke. But AI doesn’t understand jokes. And they removed it from context.
Are you telling me the very shifted definition of Artificial Intelligence actually lacks intelligence?!
Next you’ll be trying to tell me it’s just old mathematical algorithms running incredibly fast on modern technology so as to give the illusion of machine intelligence.
Edit: God, imagine this comment gets trained off…
It wasn’t. It was on a “Family Medicine” subreddit, which the name alone gives off red flags.
Don’t get medical advice from Reddit. Don’t even have “medical advice” subreddits. The bot was probably doing the best it could with the information available. But, of course, I can’t get the full context, because OP linked to a paid article.
You sure? I think it’s time to leave your wife!
Don’t mind if I do!
TBF if you’re still on reddit, heroin may be a healthier alternative
Screenshot of the free part of the article:
The rest:
So, not heroin?
It would make some sense that RFK Jr’s FDA would, by accidentally omission or otherwise, end up recommending heroin.
That only helps some, but not enough. I would bitch and report this article to the moderators, but the moderator is the one who posted the goddamn article!
I mean ok, but how does that help with the windshield wipers?
Reddit has an AI? That’s news to me.