Disaster Professor: Total Surveillance Is the Only Way to Save Humanity - The author of "The Simulation Argument" says one bad technology could destroy humanity — and the only way to prevent it is an AI overlord.


The Oxford philosopher who posited 15 years ago that we might be living in a computer simulation has another far-out theory, this time about humanity’s future — and it’s not exactly optimistic.

On Wednesday, Nick Bostrom took the stage at a TED conference in Vancouver, Canada, to share some of the insights from his latest work, “The Vulnerable World Hypothesis.”

In the paper, Bostrom argues that mass government surveillance will be necessary to prevent a technology of our own creation from destroying humanity — a radically dystopian idea from one of this generation’s preeminent philosophers.


Black Balls
Bostrom frames his argument in terms of a giant urn filled with balls. Each ball represents a different idea or possible technology, and they are different colors: white (beneficial), gray (moderately harmful), or black (civilization-destroying).

Humanity is constantly pulling balls from this urn, according to Bostom’s model — and thankfully, no one has pulled out a black ball yet. Big emphasis on “yet.”

“If scientific and technological research continues,” Bostrom writes, “we will eventually reach it and pull it out.”


Dystopian AF
To prevent this from happening, Bostrom says we need a more effective global government — one that could quickly outlaw any potential civilization-destroying technology.

He also suggests we lean into mass government surveillance, outfitting every person with necklace-like “freedom tags” that can hear and see what they’re doing at all times.

These tags would feed into “patriot monitoring stations,” or “freedom centers,” where artificial intelligences monitor the data, bringing human “freedom officers” into the loop if they detect signs of a black ball.


Two Evils
We’ve already seen people abuse mass surveillance systems, and those systems are far less exhaustive than the kind Bostrom is proposing.

Still, if it’s a choice between having someone watching our every move or, you know, the end of civilization, Bostrom seems to think the former is a better option than the latter.

“Obviously there are huge downsides and indeed massive risks to mass surveillance and global governance,” he told the crowd at the TED conference, according to Inverse. “I’m just pointing out that if we are lucky, the world could be such that these would be the only way you could survive a black ball.”
 
I sometimes wonder if the true problem is academia is that they are removed from any consequences of their ideas as though some of the best ideas and truly brilliant people have been born out of it, it also have given birth to the most destructive ideologies which despite being born out of a lack of religion, has have more bloody wars and regimes that dwarfs all holy wars before it.
 
Tfw your Freedom Tag starts beeping on your way to get some goverment-mandated food substance and a Freedom Officer apprehends you, stating that your increased of inhalation oxygen and expulsion of methane gas is too high, and you get sent to a Freedom Camp to be turned into a black ball
 
Someone give this asshole a copy of DOSBOX and SimCity 1 so he can live out his totalitarian power fantasies and let the rest of the world alone, please.
Whoa whoa whoa, that shit is too good for him. He gets a PAL region super nintendo, a shitty 3rd party controller, and a poorly translated version of the japanese port of the super nintendo sim city. Also the backup battery on the cart is dead, so no saving.
 
It's not a crime to voyeur shoot up women's skirts if the One World Government watches you shit.
 
Bostrom made some interesting points about 'Great Filters' but this seems like a terrible idea.

Though the interesting thing is that the possibility that the Great Filter exists in the future - aka there's some sort of disastrous future tech that nails all sufficiently advanced civilisations is obviously the inspiration for his total surveillance idea.

It seems like a terrible idea to be honest though. The one technology humans have discovered that could end civilisation so far, nuclear weapons, has actually led to fewer direct conflicts between states equipped with it. It's kind of striking that upto WWII there were relatively frequent battles between states with top tier militaries but since 1945 and nukes that is no longer the case. I actually suspect that in the absence of an overarching world authority well armed states are more likely to avoid fighting than poorly ones.

And of course a world government of the kind able to compel states not to fight would be a horrible tyranny anyway. You'd end up like China which had a period of technological stagnation and a strong central authority and stopped exploring

https://en.wikipedia.org/wiki/Ming_treasure_voyages#Causes_of_cessation

In fact there are many examples of human societies which had the technology to explore the world and decided not to do so. One of the benefits to having multiple states with no overarching world authority is that some might choose to explore and colonise even if others do not.

I.e. ironically his solution to a future great filter seems like something which might produce technological stagnation and prevent future space exploration.
 
If we create a global totalitarian surveillance state then our civilization should end. Although at the very least such an event would no doubt kickstart the Boogaloo.

Also I don't think for a single second that he hadn't copied The Matrix when he came up with his simulation theory. Even if he didn't see it he must have at least known about.
 
Wasn't this already a Tom Cruise movie, Minority Report? We need to arrest them before they commit any crime.

Remember, kids -- keep your thoughts and words pure!
 
Hey, the surveillance drones that peep in at the windows could also deliver packages. All hail the Amazon Police State. Only traitors have curtains, comrade.
 
Bostrom made some interesting points about 'Great Filters' but this seems like a terrible idea.

Though the interesting thing is that the possibility that the Great Filter exists in the future - aka there's some sort of disastrous future tech that nails all sufficiently advanced civilisations is obviously the inspiration for his total surveillance idea.

It seems like a terrible idea to be honest though. The one technology humans have discovered that could end civilisation so far, nuclear weapons, has actually led to fewer direct conflicts between states equipped with it. It's kind of striking that upto WWII there were relatively frequent battles between states with top tier militaries but since 1945 and nukes that is no longer the case. I actually suspect that in the absence of an overarching world authority well armed states are more likely to avoid fighting than poorly ones.

And of course a world government of the kind able to compel states not to fight would be a horrible tyranny anyway. You'd end up like China which had a period of technological stagnation and a strong central authority and stopped exploring

https://en.wikipedia.org/wiki/Ming_treasure_voyages#Causes_of_cessation

In fact there are many examples of human societies which had the technology to explore the world and decided not to do so. One of the benefits to having multiple states with no overarching world authority is that some might choose to explore and colonise even if others do not.

I.e. ironically his solution to a future great filter seems like something which might produce technological stagnation and prevent future space exploration.
Jerry Pournelle wrote a bunch of sci-fi stories with that as a premise, where the US and the USSR joined forces under a supranational government called the CoDominium. They ended up dominating other nation-states on Earth, keeping most of their citizens on a drug-fueled welfare subsidy while squeezing the remaining taxpayers to fund it, shipping off undesirables to penal off-world colonies while purposely maintaining technological stagnation to prevent a nuclear war from happening. It ultimately doesn't work and Earth becomes an irradiated mess.
 
This is just an exceptional premise from the start. Technological innovations aren't just balls you pull out of a bin at random. It's the kind of analogy that looks profound if you barely glance at it but if you look one second too long, it's nonsense.
He even gives the example of "what if instead of nukes being a really complicated thing to make, they were actually a really simple thing you could make at home with a battery?" I mean.. I don't even know what to say to that. Is there anything backing up this idea someone might accidentally concoct super Ebola nukes some day and we're just lucky it hasn't happened? I'm going to guess not. It's like someone's bong hit revelation.
 
I mean mass surveillance doesn't HAVE to be run by an autocratic central hub. Many neighborhood communities engage in public surveillance just by virtue of having a camera on every doorstop to catch would-be package thieves. Some more organized communities engage in public-state partnerships with public cameras operated under specific conditions to minimize abuse potential.

And lets not forget all those orbital satellites which can cleanly see your dick while you were skinny-dipping in the abandoned quarry. So realistically any expectation you have for privacy out in the wider world is already gone. The internet will probably be next so that mom and dad can ignore their kids without some creep online trying to cozy up to little timmy. Concerned parents ruin everything.

Reminder that fascism was very popular with Western "intellectuals" pre-WW2, and communism is still somehow popular with academics.
There are protectionists well into the modern day even though capitalism of one flavor or another is the prevailing market system globally.
 
Last edited:
  • Like
Reactions: cuddle striker
Jerry Pournelle wrote a bunch of sci-fi stories with that as a premise, where the US and the USSR joined forces under a supranational government called the CoDominium. They ended up dominating other nation-states on Earth, keeping most of their citizens on a drug-fueled welfare subsidy while squeezing the remaining taxpayers to fund it, shipping off undesirables to penal off-world colonies while purposely maintaining technological stagnation to prevent a nuclear war from happening. It ultimately doesn't work and Earth becomes an irradiated mess.

There's a name I haven't heard in a long time. Is Jerry Pournelle still alive? I used to read his column in Byte which was vaguely amusing, but all his books were those fucking terrible cast of thousands fantasy shlock where everyone had names like önly'fifty'accénts'in'this'öné. I remember he went off the deep end after 9/11. so I guess this was his senile years stuff.
 
There's a name I haven't heard in a long time. Is Jerry Pournelle still alive? I used to read his column in Byte which was vaguely amusing, but all his books were those fucking terrible cast of thousands fantasy shlock where everyone had names like önly'fifty'accénts'in'this'öné. I remember he went off the deep end after 9/11. so I guess this was his senile years stuff.
Nah, this was right in the middle of the 70s. I genuinely liked the Mote in God's Eye for what it was worth but his world building was always a bit questionable and I haven't delved too deeply into the rest of the books he churned out for that verse. He died a couple years ago IIRC.
 
No. Not just no, but hell, no. Not just hell, no, but no fucking way.

Does this stupid fuck not realize the major countries are doing exactly this, in private? Agree the AI environment needs constant monitoring, but putting everyone under constant surveillance isn't going to happen.

Here's a question that needs to be asked about the various present cyberspace/AI monitoring activities - Who watches the watchers? Then who watches that person? What's the chain of command? And how do people know they can have faith in their country's chain of command?

What this turd seems to forget is that technology is here to serve people, and people are not here to serve technology. Think this guy would want to wear the monitoring device he speaks of? Fuck, no! So why does he think anyone else would wear such a thing?

This is AOC-level stupidity. Keep them apart. Don't want them to breed a race of mega-idiots.

Jesus.
 
He literally thinks technology is just a magic ball you pull from a magic jar and then whatever happens happens. And then further thinks a better, more magical ball could be pulled from the magic jar first, which would have the magic power to prevent any other evil magic balls from coming out.
 
I sometimes wonder if the true problem is academia is that they are removed from any consequences of their ideas as though some of the best ideas and truly brilliant people have been born out of it, it also have given birth to the most destructive ideologies which despite being born out of a lack of religion, has have more bloody wars and regimes that dwarfs all holy wars before it.

So many pro-Communist academics ignore that if the revolution were to come, they would be the first against the wall.

They just think they're special and would somehow be anointed with a top position in the Party.
 
So many pro-Communist academics ignore that if the revolution were to come, they would be the first against the wall.

They just think they're special and would somehow be anointed with a top position in the Party.

Of course they would, in their eyes seeing as they believed and pushed it that makes them "heroes of the revolution" and quite naturally of course they must be rewarded for that.

Or of course they're thinking that a violent revolution totally won't end up with a complete tyrant in charge, surely they this time will be the good person who makes it work.

It's seemingly a belief system to these people that they're perfect and infallible. That's what makes them so obnoxious and funny to laugh at.
 
Back