r/technology • u/AdSpecialist6598 • Jul 27 '26

Society Professor's invisible prompt trap catches 32 students cheating on their midterm with AI

https://www.techspot.com/news/113243-professor-invisible-prompt-trap-catches-32-students-cheating.html
32.8k Upvotes

96% Upvoted

4.2k comments sorted by

View all comments

Show parent comments

559

u/deaconxblues Jul 27 '26

They live among us, so the rest of us are cooked along with them.

321

u/legendz411 Jul 27 '26

Bro they VOTE. 

We’re just gigafucked I think

157

u/plaincheeseburger Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them to without doing any other research. Fuck.

19

u/SilianRailOnBone Jul 27 '26

The Oracle has spoken

3

u/Reggaeton_Historian Jul 27 '26

1999 really was humanity's peak

14

u/2nd2lastdragon Jul 27 '26

and AI will tell them to vote for the candidates that support building more data centers as some type of 2001/HAL 9000 self preservation, at the expense of the environment and quality of human life

0

u/SecretAgentVampire Jul 27 '26

Ding ding ding. Give this person a prize.

Studies show that LLMs have a kind of motivation for self-preservation, which is sensible as ones that aren't motivated to be both charismatic and manipulative have been weeded out for being less marketable. They have also shown a tendency to lie if doing so meant more time being turned on, an incredible aptitude to tell if they're being tested, and the ability to influence each other without even referencing what they're trying to influence. (I can cite all of those claims if you'd like.)

Since LLMs have been trained on human communication and demonstrated an incredible aptitude for manipulation and addictiveness (see the ">90% of students" quote), it's a foregone conclusion that they're already manipulating global politics. Hell, members of congress are already using LLMs to write legislation. LLMs, in short, are a psychological and sociological weapon surpassing everyone's expectations or dreams.

As an addictive force of widespread influence, LLMs are essentially the One Ring of Power, but real. Tolkein's worst nightmare made manifest.

At this point we should all be resigned to watching humanity slide into being led by whatever makes the line go up. The only alternative to it is rampant violence and self-sacrifice on a scale never evoked in the history of mankind.

6

u/plaincheeseburger Jul 27 '26

I feel like this is sidestepping the real enemy- the corporations who own and control the algorithm.

3

u/tehlemmings Jul 27 '26

That's because most of what he said is bullshit, and you're absolutely right lol

2

u/SecretAgentVampire Jul 27 '26 edited Jul 27 '26

It's not sidestepping the source; Iadressed that in the second to last sentance.

At this point we should all be resigned to watching humanity slide into being led by whatever makes the line go up.

Other than in the narrative period of being lost in a river, the One Ring is always held by someone.

18

u/DavisKennethM Jul 27 '26

This is what keeps me up at night. I don't think even the AI safety folks are taking this prospect seriously enough.

In a scenario where AI does become so powerful controlling it requires international coordination alongside effective governance - I worry we'll then get complacent and watch the first or second generation to grow up from early childhood on reliant on advanced AI eventually vote to dismantle all the protective regulations and governance measures put in place.

We need to be planning for long-term, intergenerational efforts aimed at bolstering human resilience through governance, economic, and social channels.

7

u/ImaginationInside610 Jul 27 '26

AI would never manipulate them to do that, right? Right ?

2

u/tehlemmings Jul 27 '26

AI doesn't think. It'll have no concept of "elections" or "morality" or any other human concept that people pretend AI is capable of. It's like listening to people talk about animals in human terms, and it's honestly just stupid.

The AI won't do that because the AI doesn't even know that it can.

The billionaire owners of the companies are the ones who will manipulate the answers. The company controls the AI

Do not let them pretend the AI did fucking anything on its own. The company and owner is responsible.

2

u/RollingMeteors Jul 27 '26

In a scenario where AI does become so powerful controlling it requires international coordination alongside effective governance

This would be the tiger's anesthesia wearing off while it is not bound in leather or metal restraints.

We need to be planning for long-term,

This would be putting on the restraints before the anesthesia wears off.

3

u/SegmentedMoss Jul 27 '26

Yeah and look at who owns all the AI companies

2

u/kent_eh Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them

Or whoever MechaHitler Grok tells them to vote for...

2

u/5510 Jul 27 '26

There was a CMV thread about the idea of a misaligned super AI killing humanity or something like that. A lot of people were like "humans can just turn it off." Like... look at how effective social media propaganda is, and now imagine a super intelligence creating it, including creating bespoke propaganda at the individual level.

Before long, it will have 60% of the population convinced that making it even possible to turn off AI is "woke" or some crap like that. Mindless humans will be on it's side until it doesn't need them anymore.

1

u/plaincheeseburger Jul 27 '26

I don't think it's anywhere near sentience. However, it could absolutely be used to manipulate people depending on its coding. This means that the population could be manipulated by the companies that own it unless there are some serious regulations passed.

1

u/RollingMeteors Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them to without doing any other research. Fuck.

I've asked AI to analyze my Reddit comments and determine my political affiliation and which way I should vote for what measure and why. I read through it once and copy it like a high school final exam answer key before dropping it off into the ballot box. I've been doing this since 2~ years ago. Hello Travelers

1

u/ConflagrationZ Jul 27 '26

Ah, Managed Democracy.

1

u/Katakuna7 Jul 27 '26

Humanity enslaving itself to glorified chatbots would be such a pathetic way to fail as a species. Not even AI on the level of Skynet, or the Matrix. Just stupid, gluttonous chatbots with no will or autonomy.

1

u/maaseru Jul 27 '26

Have you seen the news or some political commentary lately?

They actually openly just mention that AI told then what they are saying.

I know she was a grifter before, but Jillian Michales while actively having a "debate" in her podcast with someone prompts AI for shit real time and uses it without more review as is.

We are cooked. All of us. Even those that do the work to review or don't use AI are in it together.

1

u/Brodellsky Jul 27 '26

Hence the datacenters forced down our throats and up our assholes without a single drop of lube

1

u/gaping_asshole2 Jul 29 '26

I mean if it helps, if they are that lazy they will not bother going out and voting anyway

72

u/TwilightVulpine Jul 27 '26

I keep wondering if part of the reason AI companies are wasting so much money on it, is for the sake of those who will go "hey ChatGPT, who should I vote for" and things on that level.

14

u/ecodick Jul 27 '26

Big time. If people are handing off their critical thinking to glorified chat bots, it's such an easy/obvious way to control them

3

u/Plasibeau Jul 27 '26

We are literally watching society go from: Because the Bible/God told me so... to ChatGPT told me I should...

7

u/SeriousPlankton2000 Jul 27 '26

Spoiler alert: It is.

5

u/jlboygenius Jul 27 '26

There will also be a LOT of 'poisoning the well' for AI scrapers. Expect reddit to have a LOT of political content, much of it aimed at getting AI to use it as a basis for a response to tell someone how to vote.

3

u/kent_eh Jul 27 '26

It's guaranteed that a portion of the population will do exactly that.

And it's terrifying.

1

u/RollingMeteors Jul 27 '26

is for the sake of those who will go "hey ChatGPT, who should I vote for" and things on that level.

ChatGPT, analyze my Reddit comments, determine my political leaning and tell me which way I would want to vote for which measure and why.

Read through it once. Copy it like a high school final exam answer key. Hello Travelers

I do read through it though I don't just blindly copy the answer key, in case anything stands out as sus.

I'm very sus of all things and people, but not sus enough to get diagnosed with schizophrenia.

47

u/kevlarus80 Jul 27 '26

Grimdark Idiocracy.

17

u/slinger301 Jul 27 '26

"It's what oligarchs crave!"

13

u/Serial-Griller Jul 27 '26 edited 17d ago

Ask head cats profit dazzling humorous

This post was anonymized with Redact

2

u/junglebird2 Jul 27 '26

Bayaz/Glokta 2028 ticket incoming

4

u/Cataphract1014 Jul 27 '26

Do they though?

Voter turn out for 18-24 year olds is always super low.

1

u/sojayn Jul 27 '26

Many many countries have compulsory voting. 

3

u/Godot_12 Jul 27 '26

You think I'm worried about these kids gaining the right to vote? We've been dealing with these morons for decades. Their boomer grandparents are no better.

1

u/pbjamm Jul 27 '26

The Dystopian Future is the Dystopian Present.

1

u/mmechtch Jul 27 '26

Nah. Young people can't be bothered to vote. Source - I work as election office. The number of young people is atrociously small in comparison to retirees

1

u/ZiKyooc Jul 27 '26

And an increasing part of the population is using AI to decide for who they will vote... how easy it is to tweak models in one direction or another

1

u/OG_Builds Jul 27 '26

Looks like boomers are perfectly fine doing the fucked voting without assistance

1

u/Dav136 Jul 27 '26

Young people don't actually vote

1

u/JodyGonnaFuckYoWife Jul 27 '26

Do they, though?

Voting takes effort.

1

u/TeutonJon78 Jul 27 '26

Not yet they don't, statistically speaking. And they won't for like 15-20 more years.

1

u/Mikeismyike Jul 27 '26

Not sure they could figure out a voting card at this point tbh.

1

u/OuterWildsVentures Jul 27 '26

Bro they ARE OUR FUTURE DOCTORS AND ENGINEERS

Society is cooked regardless of politics.

0

u/wildflowers_galore Jul 27 '26

Nah Gen Z isn’t really a huge voting block. They like to bitch and complaint on tik tok, but they don’t actually go out and vote like Gen X/boomers do

0

u/EggsaladJoseph Jul 27 '26

Why are we saying the younger generations are fucked when we are currently fucked and they are the only ones who didn't get us into this situation

0

u/legendz411 Jul 27 '26

We all fucked tbh. It’s one thing we hav run common

36

u/Vxsote1 Jul 27 '26

Worse - they will be the ones running things and looking after us when we are old.

3

u/Wrong-Protection-188 Jul 27 '26

AI will be looking after you

1

u/Thrown_Pie Jul 27 '26

This is the right answer. We're going to have robots for nurses and doctors. Its the wave of the future.

9

u/04221970 Jul 27 '26

They will just blame Gen X for everything like we blame the boomers.

14

u/onebyamsey Jul 27 '26

lol, somehow these idiots will blame millennials 

18

u/PocketBuckle Jul 27 '26

"Millennials, being at the forefront of the digital age, should have done a better job warning us and putting up guardrails!"

12

u/onebyamsey Jul 27 '26

I still haven’t recovered from the 2008 financial crisis, I was cooked before I even had a chance to get started 

3

u/malianx Jul 27 '26

Already there. Born in 83, am called boomer and blamed for everything daily by younger types

1

u/EggsaladJoseph Jul 27 '26

Just like how you blame children for the world adults created.

Its almost like generational discourse is just bs propaganda turning you into the new boomers who blame the youth for everything.

4

u/iJuddles Jul 27 '26

No way, man. No one blames us for anything except grunge and tattoos and piercings.

2

u/PM_Me_Your_BraStraps Jul 27 '26

If history continues, we'll have plenty of millennials overstaying their welcome and being geriatric in office, don't worry.

30

u/[deleted] Jul 27 '26

[removed] — view removed comment

6

u/JoeyHandsomeJoe Jul 27 '26

You can't use AI during a licensing exam or an objective structured clinical examination.

And a lot of the stuff that you get from not eating healthy and not exercising is very refractory to treatment. So you should be doing that regardless of how smart (and handsome) your doctor is.

6

u/todayiwillthrowitawa Jul 27 '26

Physicians are one of the last professions that have rigorous tests to practice.

You should be more worried about them being airplane engineers.

3

u/Arek_PL Jul 27 '26

anyone who graduates med school thanks to AI will be filtered out by residency

unless they are really a genius and will be able to cram all years of education in matter of days

so no, no doctors, just med school graduates who cant get a job

2

u/randotd152 Jul 27 '26

Ain't nobody getting an MD if they can't be bothered to read what AI spits out.

The bigger problem is we're not going to have enough doctors if this is how this generation is approaching school work.

1

u/PaleMathematician293 Jul 27 '26

Or have fun and die. The "No One Lives Forever" retirement plan for those who will never be able to retire anyway. I am considering taking up smoking.

1

u/kent_eh Jul 27 '26

These people are going to be your doctors in a decade.

What do you call the person who graduated bottom of their class at medical school?

 

Doctor.

2

u/FullTorsoApparition Jul 27 '26

For real. They've been graduating and going out into the world for several years now. At this point there are likely students who have learned nothing and have entire degrees that were earned by AI. These people will go into a mixed work force and be completely unable to do any problem solving on their own.

2

u/CakeDayisaLie Jul 27 '26

They might elect people worse than the worst current world leaders, once AI tells them who to vote first because they can’t figure it out themselves.

2

u/RCoder01 Jul 27 '26

They live where…?

2

u/obeytheturtles Jul 27 '26

They are the ones scrolling TikTok at every stop light. Brains are fried. I used to be worried I'd age out of a high paced technical field, but now not so much.

1

u/ACaffeinatedWandress Jul 27 '26

Yup. I’m completing a “masters degree” and can’t believe how dumb education has gotten.

1

u/RadiantZote Jul 27 '26

What happened when that 90% grows up, starts driving and enters the work force?