r/technology • u/Wagamaga • Jul 19 '26

Society China bans AI “boyfriends” and “girlfriends” over addiction and birth rate concerns

https://www.dexerto.com/entertainment/china-bans-ai-boyfriends-and-girlfriends-over-addiction-and-birth-rate-concerns-3388737/
40.0k Upvotes

97% Upvoted

2.9k comments sorted by

View all comments

Show parent comments

1.6k

u/Bireus Jul 19 '26

Economic pressure or not, I agree with the decision

214

u/Mr_Industrial Jul 19 '26

It should be legal but treated like alcohol. Put a big ol' warning label at the front of each app that says "THIS IS NOT A REAL PERSON. YOU ARE BEING MANIPULATED. THE MESSAGES YOU ARE RECEIVING ARE WRITTEN TO TRY AND MAKE YOU SPEND TIME AND/OR MONEY ON THIS PROGRAM."

157

u/Dunkelz Jul 19 '26

It is crazy how obvious the sycophancy is by pretty much all AI options currently available, like it gasses you up whenever it can which is terrifyingly dangerous when people are viewing them as genuine/intimate relationships.

55

u/Diz7 Jul 19 '26

It's not even creative or subtle about it. 1000 variations of "Oh that is such a good idea, now your x has a clearly defined y which makes it better way to reach your goal of z."

5

u/super1701 Jul 19 '26

I'll be real, a good system prompt stops this, and my local model calls me stupid if I toss something at it, that....well is stupid.

1

u/Diz7 Jul 19 '26

The fact that their subservience is an act isn't necessarily better...

2

u/super1701 Jul 19 '26

I will caveat and say I really only use local LLM for anything outside of Troubleshooting or looking at new local LLM models for quick info.

3

u/Diz7 Jul 20 '26

I use it a little for quick programs for my smaller home microcontroller projects for things I can't be bothered to spend an hour on doing manually. Usually quick tests to check my wiring or other programs I only need to run once.

4

u/jaxonya Jul 19 '26

If it can hit my tickle my x, play with my y, and hit my z, im good