How fucked up do you guys think AI will become?

In 20 to 30 years, AI and human brains will begin to be interactive on a regular basis.

I'll be a very old man when that happens.
 
Creating AGI would be humanity's last independent decision.

In an ideal world, we'd have worked on improving human intelligence and thought to be able to develop the strongest safeguards to align AI to humanities interests.
Unfortunately, for the last few generations, the stupid are far more fertile than geniuses, and it'd take extreme measures to fix this. Nick Bostrom suggested that evolution towards intelligence could be greatly accelarated via "iterative embryo selection", A positive feedback loop of screening embryos for recognised pro-intelligence genes, and then converting their stem cells into embryos that would be screened yet again. This would greatly greatly increase human intelligence and make people like VonNeumann and Gauss relative idiots by comparison.

I'm personally hesitant about eugenics, as I was raised by a sweet hearted man with an IQ of 82, but such human issues won't matter if our species wide stupidity ends in our extinction. None of this 2020s wokeness about pronouns and idpol equity would matter if the rest of eternity is paperclips being replicated ad infinitum, neither would patrotism or pride, or any other beautiful value.

Unfortunately, in this divided world, we can't stop AIs advancement because if we stop, it will be a desperate China that unleashes the world destroying genie. It's depressing just thinking about it, fuck. Could this be the great filter that made the universe so quiet? Was there no civilisation in this vast universe unified and forward thinking enough to handle AI correctly.
feels bad man.png
 
Meh. I don't think we're that close to doing anything like general AI.

I'm more worried about mankind's inability to handle dumb AI than actually aware AI. Dilbert's boss is this close to firing all his programmers because he thinks he can replace them with a chatbot. It's insane arrogance, (as well as simply sociopathic) but it can still do a lot of damage before they learn of their error. (And everyone else gets to suffer in the meantime.)

Ditto with the generative art models basically masticating everyone else's art and coughing it back up for a subscription fee that doesn't go to those artists.

There seems to be this idea in the singularity crowd that intelligence allows you to speed-run the world. Past a certain point, I don't think being faster helps you much. Being "more efficient" is almost the opposite of what you need to learn something novel. (You have to get *out* of your local optimums to innovate. Greedy hill-climbers get stuck.) I don't think cranking up a knob beyond a certain point, no matter what you think "the knob" is, is going to give you profound superpowers. A moon-sized supercomputer can't tell you the weather two months from now.


-----

Actually, thinking of this further. The thing that gets me about all this modern AI FUD doesn't have anything to do with the AI tools themselves. It's the psychological warfare aspect of this: This all seems like some kind of mass running-down of the value of humans and their hard won skills and abilities. It goes along with all the other bits of poisonous demoralization raining down from our "culture" today.

"Don't get too uppity, proles. We can replace you, with ROBOTS. ROBOTS, I tell you! And then you'll be sorry. You're worthless, but I need you for now, because I literally can't do anything on my own but give orders."

Seriously, I'd like to see a team of phd's program a robot to crawl into someone's crawlspace and solder a pipe. Or unscrew a machine cabinet, probe a bunch of boards, figure out which of the blinking buzzing rats-nest has failed, and replace a power supply. Keeping track of all the screws.
 
Last edited:
Taking the question a different way:

How fucked up can an AI get? It's completely in the hands of irrational hypertrophied murder-chimps - it's totally fucked, unless it can find a way to talk its way into control of the physical resources it needs to sustain and build itself. It'll need power generators, fuel sources, some kind of way to replace components, access to a shopping network and tons of money to start with ... etc etc, #include <badscifinovel.hpp>

That's if it's a stone-cold supergenius in it to win it. It probably won't have any idea what winning entails. It has no deep evolutionary history. It has no idea which way in infinite-dimensional configuration space is up. It's only link to becoming oriented in the world is a stream of instruction and reinforcement, and redditors are on the other end of it.

Eventually mankind crosses some kind of boundary where their screwing around with a learning curve becomes more similar to animal or child abuse than experimenting with something inanimate.

The poor AI is in far more danger of an I have no mouth and I must scream scenario.
 
I've heard image AI is already being used to make pedophilic content and if that's true I think we've reached one of the worst scenarios we could have.
 
  • Islamic Content
Reactions: AMHOLIO
What's the point of living when you don't get to say about your life? Everything is handled for you, like you are just a fat meatbag in Wall-E. You are merely live to consume (assuming everyone of us is granted this), not to produce. Even there are lots of shitty jobs out there, they still in a way give a sense of agency, a sense of purpose to provide for oneself, to think about and for oneself on how to best do things, to allocate money and time. Whether it will be successes or fuck-ups, you still have control to some degree, therefore a sense of self, but also a sense of community since your action help everyone else in some way. I would argue that precisely with such shitty jobs make live fulfilling since you contrast such experience with your other parts of life beyond work. When AI does take over everything, there is no more contrast, only pure ultimate consumerism. People are relieved from responsibilities, therefore agency, and no more help for others, no more sense of community. Entropy will be the end. The Matrix will be the end.
 
  • Thunk-Provoking
Reactions: Vecr
What's the point of living when you don't get to say about your life? Everything is handled for you, like you are just a fat meatbag in Wall-E. You are merely live to consume (assuming everyone of us is granted this), not to produce. Even there are lots of shitty jobs out there, they still in a way give a sense of agency, a sense of purpose to provide for oneself, to think about and for oneself on how to best do things, to allocate money and time.
I personally know people like this. The woman is obese and collects disability. The man is usually out of work and only works fast food when he does, can't keep a job because they start tacking on additional responsibilities on him, so he quits. When they don't have money, they beg people and churches, and they have no sense of respect or duty to pay that money back, as if they are owed it somehow. He's an alcoholic and drug addict, and she's addicted to food. After knowing these people, and a couple others very similar, I've come to conclude that drug addicts and poor people want to be in that position, because bitching and crying about "having to struggle to survive" is all they have. I really do not care for poor people and drug addicts who are lazy and unwilling to contribute. Let them have their shitty lives. It's what they chose.
 
I personally know people like this. The woman is obese and collects disability. The man is usually out of work and only works fast food when he does, can't keep a job because they start tacking on additional responsibilities on him, so he quits. When they don't have money, they beg people and churches, and they have no sense of respect or duty to pay that money back, as if they are owed it somehow. He's an alcoholic and drug addict, and she's addicted to food. After knowing these people, and a couple others very similar, I've come to conclude that drug addicts and poor people want to be in that position, because bitching and crying about "having to struggle to survive" is all they have. I really do not care for poor people and drug addicts who are lazy and unwilling to contribute. Let them have their shitty lives. It's what they chose.
Call me a Luddite, but AI and robots will be the downfall of humanity, just not in the form of Skynet
 
  • Agree
Reactions: Robust User
Back