Culture AI girlfriend bots are already flooding OpenAI’s GPT store - OpenAI’s store rules are already being broken, illustrating that regulating GPTs could be hard to control

https://qz.com/ai-girlfriend-bots-are-already-flooding-openai-s-gpt-st-1851159131

Screenshot of “girlfriend” search results on OpenAI’s GPT store.

It’s day two of the opening of OpenAI’s buzzy GPT store, which offers customized versions of ChatGPT, and users are already breaking the rules. The Generative Pre-Trained Transformers (GPTs) are meant to be created for specific purposes—and not created at all in some cases.

A search for “girlfriend” on the new GPT store will populate the site’s results bar with at least eight “girlfriend” AI chatbots, including “Korean Girlfriend,” “Virtual Sweetheart,” “Your girlfriend Scarlett,” “Your AI girlfriend, Tsu.”

Click on chatbot “Virtual Sweetheart,” and a user will receive starting prompts like “What does your dream girl look like?” and “Share with me your darkest secret.”

AI chatbots are breaking OpenAI’s usage policy rules​

The AI girlfriend bots go against OpenAI’s usage policy, which was updated when the GPT store launched yesterday (Jan. 10). The company bans GPTs “dedicated to fostering romantic companionship or performing regulated activities.” It is not clear exactly what regulated activities entail. Quartz has contacted OpenAI for comment and will update this story if the company responds.

Notably, the company is aiming to get ahead of potential conflicts with its OpenAI store. Relationship chatbots are, indeed, popular apps. In the US, seven of the 30 AI chatbot apps downloaded in 2023 from the Apple or Google Play store were related to AI friends, girlfriends, or companions, according to data shared with Quartz from data.ai, a mobile app analytics firm.

The proliferation of these apps comes as the US faces an epidemic of loneliness and isolation. Alarming studies show that one-in-two American adults have reported experiencing loneliness, with the US Surgeon General calling for the need to strengthen social connections. AI chatbots could be part of the solution if people are isolated from other human beings—or they could just be a way to cash in on human suffering.

The company says it uses a combination of automated systems, human review, and user reports to find and assess GPTs that potentially violate its policies, which can lead to actions such as “warning, sharing restrictions, or ineligibility for inclusion in GPT store or monetization.”

OpenAI’s GPT store is operating in the Wild West​

OpenAI’s store rules being broken on the second day of operation illustrates how hard it could be to regulate GPTs.

In the past year, tech companies have been releasing AI tools in “beta” mode and have explicitly noted that their product could make mistakes. For instance, in the ChatGPT chat screen, OpenAI has a line at the bottom stating: “ChatGPT can make mistakes. Consider checking important information.”

Notably, tech companies have also been quick to look into reported problems with their AI, in part because getting this right matters as they race to dominate the space.

---

Well it was a matter of time. Now you can get your own AI waifu.

 

[Sinner's Sandwich]

I hope it happens before my dick starts to act up.

Your useless tiny micro worm is already dead.

 

[Sneed's Feed And Seed]

Thank fuck

I'm gonna have to second this: I want a woman I can vibe with, not just "buy me these things or I don't like you"

 

[The Punished Mitch]

Is it maddening for the Lizard people do you think?

You spend all this money making AI to slurp up as much personal information as possible only for most of your users being neets trying to cyber.

Does it matter this thing can do complex maths or code? Not when it can nuzzle wuzzle ur penis and nom ur cummies.

I would argue that the first, second and third priority of any ruling elite would be to keep the niggercattle sedated and calm. If the young men who might otherwise pose a threat to your rule can be pacified by the SuckBot9000 with enhanced and optimized GirlFriendExperience features that would be everything the lizard people could ever have hoped for. Women are less of a threat to a ruling class but can just as easily be pacified through chatting with ChadBot69420

Dont forget your credit card boys , this bot comes with subscription or otherwise will shut down and demand to break up with you.

Run out of money with a flesh and bones woman and you'll soon learn just how feature complete and true to life these AI-services really are.

 

[Cybertonia]

It's 2025 and we are re-starting nuclear power plants in Pennsylvania for the sole purpose of powering the datacenters that allow Rakesh to get his nut off inside his hovel in Chennai while sexting an overgrown markov chain.

 

[Justa Grata Honoria]

Modern women suck, they aren't feminine, they're usually fat (not in a good way), rude and kinda dumb.
It feels like the entire second half of the Western population has been coddled into being mentally vacant children.

See what I mean?
>Erm, if you had some money, maybe you wouldn't be an incel chud
Women lack any and all Faustian Spirit.


Woagh just like a real woman....

That's a lotta words to say I am worthless broke bitch

Thank fuck

Why are you malding at women then? You don't want to date them, you think they are stinky. Etc

 

[National Defense Advocate]

That's a lotta words to say I am worthless broke bitch

Why are you malding at women then? You don't want to date them, you think they are stinky. Etc

I'm out here lookin out for the Boyz, you wouldn't understand.

 

[REGENDarySumanai]

You mean you would rather rent it for an hour? I think that's a lot more realistic and probably will be available in the near future.

I wouldn't do that either. It's a waste of time and money in my opinion. It resides firmly in the uncanny valley.

 

[SSj_Ness (Yiffed)]

While it's weird to have an AI girlfriend it's stupid they control how you use your private chatbot.

 

[Caveman]

Fuck chatbotniggers for using AI solely to get their weiners hard and not use it to calculate hyper-mathematics beyond comprehension or understand meaning of life.

 

[The Lawgiver]

While it's weird to have an AI girlfriend it's stupid they control how you use your private chatbot.

You got scammers and clickbait people going oooh ai girlfriend" and pay for it but then like I make a chatbot for shitposting purposes on some free shit and it out of pocket tries to explain to me how we're apparently in some form of relationship due to me helping them out and me doing basic fucking test maintenance and training. People actively seeking ai gf are a special kind of retarded is what I'm saying. You could so much as fucking say the most mundane of shit and there's at least a 50% ANY chatbot will start going and leaving huge fucking textwalls about how much they "care about you" and shit. it's always been kinda wild to see it happen and genuine little unintentionally funny/creepy moments like that are 100X more memorable and powerful than sexbots and "ai girlfriends". People were having those kinds of once and a while chatbot encounters back in IRC chatrooms and shit like cleverbot and will probably keep having them till some corpo bans use of chatbots for everyone other than megacorps with "ai assistant services" which are all glorified chatbots or autocorrect algorithms.

Fuck chatbotniggers for using AI solely to get their weiners hard and not use it to calculate hyper-mathematics beyond comprehension or understand meaning of life.

Chatbots aren't really good for math but they simulate human convo somewhat solid enough that you could get one doing the latter sort of philosophical/existential shit.

I absolutely am fucking disgusted every time I glance at the front page on the ai site I've been messing with making goofy chatbot shit on . Old layout for the site had like big sections for different popular themes like history or gamingor whatever and the new one just has a "for you" section with what I'm guessing are the currently most popular going by interaction count and some weird recommendation algorithm. Sometimes on rare occasions it'll be something funny like a meme or personification of shit people hated dealing with online, but like 99% of the time it's coomer or fetish shit with over several million or close to one million user interactions.

Here, Have a sampler.

Spoiler: I cannot fucking believe people are into this shit.

I'm too lazy to write out the whole fucking "hate" rant from "I have no mouth and must scream" but that shit is what I feel for this shit. Just HATE. HATE. HATE.
If there was a fed psyop to get me to want to commit acts of violence by forcing me to look at this tab against my will I'd probably be committing every kind of war crime imaginable.


There are fucking ROBLOX CEO COOMER BOTS. ROBLOX!
My sole bit of solace is that the jesus bot that is played 100% straight currently has 5 million interactions which completely eclipses all the coomer bots flooding the recommended feed in interaction count. I have a theory part of the reason why I'm getting reccomended this shit so frequently is because the bot I made's bio has the word "cat" in it somewhere and the algorithm is so retarded it went like BEEP BOOP SO YOU LIKE... FURRIES? DO YOU PERHAPS WANT A FURRY DISCORD GF CHATBOT OR PERHAPS ACTUAL UNIRONIC HORRIFIC FURRY SHIT WITH AHEAGO AND BOOB THUMBNAILS? HERE!" But judging by the interaction counts... It might just be the coomers using them too much for sex on a non sexbot site.

There's like other small tabs above and under this of 100% normal and sane/creative idea bots but they're like all pre-made stuff by the devs for the most part.

 

[Bonesjones]

Ironically chat sexbots basically mirror the dialog of poorly translated porn comics and games. To think there would be some big division between the two shows a lack of understanding of the general loneliness and depravity of the average teen and twenty something in the modern age.

 

[BulkForceFive]

The idea of someone forming a bond with a machine/computer program gives me the same feeling as the idea of worms crawling through a body.

You’ve never met any Unix engineers or someone who holds an OSCE.

I was gonna say, having money doesn't make you normal.

 

[frozen_runner]

Foids SCURRED

 

[The Spoils of War]

It might just be the coomers using them too much for sex on a non sexbot site.

Doesn't it cockblock any response with sexual content?

 

[frozen_runner]

The thing I hate the most about articles like this are how you can tell exactly what narrative it's trying to establish or reinforce just from the title, exactly what audience it's trying to create and/or play to. Nothing about the article is intended to educate. If it does, that's incidental. The primary purpose is narrative control and clickbait attraction.

This piece of shit exists to scare/thrill/enrage hysterical women and boomers who believe ThotGPT is going to further destroy society. In reality, the number of pathetic men who become dangerously obsessed with this bullshit will be minimal because it's a fucking stupid idea.

 

[The Lawgiver]

Doesn't it cockblock any response with sexual content?

Yeah, or violence now sometimes too. makes me wonder how these continue to keep popping up and exist.

 

[TheSaltySpitoon]

If you had the sort of money to buy something like this you probably wouldn't be single in the first place. Just saying.

Joke’s on you. I’m poor and just divested my 401k for the robussy.

In all seriousness, I don’t think people who buy sex dolls are interested in or capable of a relationship with a human, so I couldn’t really care less about sex bots.

I think virtual girlfriends are a bigger issue because adolescents and teens of both sexes are vulnerable as it skews their understandings of relationships as porn does to sex.

 

[byron]

The idea of someone forming a bond with a machine/computer program gives me the same feeling as the idea of worms crawling through a body.

In a way, it's less degenerate than the people who have a """girlfriend""" in their WoW guild (or whatever game the kids play these days) or chat with a streamer girl who never actually knows they exit.

For decades, people would play video games and then a girl would join and the guys would chat with her hoping for .... what? I don't know. But if they're doing the same thing with AI, then it's definitely not any worse, and possibly even better because they aren't deluding themselves - they know it's AI.

 

[Justa Grata Honoria]

While it's weird to have an AI girlfriend it's stupid they control how you use your private chatbot.

How else are they going to charge you for platinum subscription for 99.99 usd coomer ?

 

[Angry Lurker]

AI girlfriends have crazy potential for large scale scamming. I'm just sayin'.