Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 ... 6 7 [8] 9 10 ... 14

Author Topic: How to Defeat a Singularity-Level AI?  (Read 27744 times)

Realmfighter

  • Bay Watcher
  • Yeaah?
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #105 on: January 05, 2011, 04:49:45 pm »

Hysteria and Paranoia are not very far apart.
Logged
We may not be as brave as Gryffindor, as willing to get our hands dirty as Hufflepuff, or as devious as Slytherin, but there is nothing, nothing more dangerous than a little too much knowledge and a conscience that is open to debate

forsaken1111

  • Bay Watcher
    • View Profile
    • TTB Twitch
Re: How to Defeat a Singularity-Level AI?
« Reply #106 on: January 05, 2011, 04:50:58 pm »

Hysteria and Paranoia are not very far apart.
The AI likely wouldn't even be public knowledge, so the people would suspect each other I'd imagine. Investigations ensue, riots, etc. Yay people died, population control.
Logged

Realmfighter

  • Bay Watcher
  • Yeaah?
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #107 on: January 05, 2011, 04:52:03 pm »

They would be randomly flailing about, possibly connecting with the AI.
Logged
We may not be as brave as Gryffindor, as willing to get our hands dirty as Hufflepuff, or as devious as Slytherin, but there is nothing, nothing more dangerous than a little too much knowledge and a conscience that is open to debate

forsaken1111

  • Bay Watcher
    • View Profile
    • TTB Twitch
Re: How to Defeat a Singularity-Level AI?
« Reply #108 on: January 05, 2011, 04:53:30 pm »

They would be randomly flailing about, possibly connecting with the AI.
Cool... you're right. There is no way an AI could ever fool people. You win internets.
Logged

Sowelu

  • Bay Watcher
  • I am offishially a penguin.
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #109 on: January 05, 2011, 04:57:41 pm »

Just be really REALLY careful when ethics to something smarter than you. Sure, it sounds good when you say "it's okay to give criminals the death penalty, because they would have hurt more people if we released them. It's better to kill one to save many."

It might then go "Kill few to save many = acceptable. Oh look the earth is overpopulating, resources dwindling... Solution: Wipe out 30% of human population to ensure continued human growth and prosperity."

That's not what I'd expect out of smart AI. Any sufficiently educated AI would realizing that trying to kill 30% of humanity would make humanity threaten its existence.

I'd expect a singularity level AI to be as smart as a very intelligent human. The only question is how nurture will form its 'personality'.

For me, a singularity-level AI has by definition the reflexes of a world-class Starcraft player, expanded to work on a global scale, on all tasks, including holding conversations and diplomatic relations with everyone it wants to simultaneously; and while its capacity to reason might not be god-tier, it is indeed on the level of a VERY intelligent human who has waaaay more time to think than any human does (very fast processing) + can crunch a lot of data at once.  Imagine a human spy agency going through files to figure out the best diplomatic contact to bust into an organization.  Now imagine that a singularity-level AI is doing the same thing, except it has an essentially-infinite number of agents, can watch all cameras at once 24/7, can data-mine the entire history of everyone, research everything with no constraints on manpower, and can simulate anyone it wants to in any form of communication that's less than face-to-face.  Fictional spy agencies are often portrayed as being good at things like "Hmm, this guy's records implies that he's an alcoholic in a failing marriage, he has the least to lose, he's an ideal target", or digging up information to blackmail someone with; an AI would be better at all those things and could manipulate an AMAZING number of people.

Think of the Illuminati, and you've got the planning capacity and resources of an AI.  Except that the AI is faster.  It can totally act in secret and create wars to achieve its objectives, then quietly eliminate the people it manipulated.

Sneaking over to that "captain of the Enterprise being removed" thing, remember that a singularity-level AI could fake any video it wanted and release it to anywhere...
« Last Edit: January 05, 2011, 04:59:44 pm by Sowelu »
Logged
Some things were made for one thing, for me / that one thing is the sea~
His servers are going to be powered by goat blood and moonlight.
Oh, a biomass/24 hour solar facility. How green!

MetalSlimeHunt

  • Bay Watcher
  • Gerrymander Commander
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #110 on: January 05, 2011, 04:59:45 pm »

They would be randomly flailing about, possibly connecting with the AI.
Cool... you're right. There is no way an AI could ever fool people. You win internets.
It's not possible to kill off billions of individuals without leaving some trail. Once we humans realize that reality is apparently trying to kill us for no reason, the AI's plans will be discovered by someone at some point.
Logged
Quote from: Thomas Paine
To argue with a man who has renounced the use and authority of reason, and whose philosophy consists in holding humanity in contempt, is like administering medicine to the dead, or endeavoring to convert an atheist by scripture.
Quote
No Gods, No Masters.

forsaken1111

  • Bay Watcher
    • View Profile
    • TTB Twitch
Re: How to Defeat a Singularity-Level AI?
« Reply #111 on: January 05, 2011, 05:00:18 pm »

They would be randomly flailing about, possibly connecting with the AI.
Cool... you're right. There is no way an AI could ever fool people. You win internets.
It's not possible to kill off billions of individuals without leaving some trail. Once we humans realize that reality is apparently trying to kill us for no reason, the AI's plans will be discovered by someone at some point.
Good to know.
Logged

Realmfighter

  • Bay Watcher
  • Yeaah?
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #112 on: January 05, 2011, 05:00:58 pm »

Thirty percent of the human population is Approximately 2,100,000,000 people.

That number is enough to make anyone go insane, something you don't want happening to people you rely on not to make the world explode in a ball of nuclear fire.
Logged
We may not be as brave as Gryffindor, as willing to get our hands dirty as Hufflepuff, or as devious as Slytherin, but there is nothing, nothing more dangerous than a little too much knowledge and a conscience that is open to debate

forsaken1111

  • Bay Watcher
    • View Profile
    • TTB Twitch
Re: How to Defeat a Singularity-Level AI?
« Reply #113 on: January 05, 2011, 05:03:53 pm »

Thirty percent of the human population is Approximately 2,100,000,000 people.

That number is enough to make anyone go insane, something you don't want happening to people you rely on not to make the world explode in a ball of nuclear fire.
I never said 2 billion people would die overnight.

How much attention would the world really pay if a deadly jungle disease broke out in a third world country, killing millions? If food contamination due to poor working conditions killed off several hundred thousand people in china? Certainly some people would notice, and some may even care, but most of the world would see it on the news and go "oh no, that's terrible" and then go buy a starbucks(or local equivalent) coffee to feel better.

Hey this would make a good book.
Logged

Sowelu

  • Bay Watcher
  • I am offishially a penguin.
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #114 on: January 05, 2011, 05:14:02 pm »

This thread is now about I hate that particular form of forum degeneracy.

I know there's gotta be plenty of good books on the subject.  What good sci-fi books about humanity vs. singularities are out there?  My favorite of all time is Blood Music.  There's a little bit of body horror, but it is a VERY good book, and NOT a short book.  Singularity fans will get a kick out of it.  (It starts out with a guy who was working on a biological intelligence.  He injects himself with it to save his work from being destroyed, because hey, he can salvage it later and his immune system will just destroy it, right?  Fun ensues.)

Also good for exploring a low-level strong AI, not quite singularity level, what it can do and how it could die, is The Moon is a Harsh Mistress.  I love you Heinlein, I love you so much.  Required reading.
« Last Edit: January 05, 2011, 05:15:33 pm by Sowelu »
Logged
Some things were made for one thing, for me / that one thing is the sea~
His servers are going to be powered by goat blood and moonlight.
Oh, a biomass/24 hour solar facility. How green!

Virex

  • Bay Watcher
  • Subjects interest attracted. Annalyses pending...
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #115 on: January 05, 2011, 05:15:16 pm »

They would be randomly flailing about, possibly connecting with the AI.
Cool... you're right. There is no way an AI could ever fool people. You win internets.
It's not possible to kill off billions of individuals without leaving some trail. Once we humans realize that reality is apparently trying to kill us for no reason, the AI's plans will be discovered by someone at some point.
That would only matter if humanity would at that point still be able to stop it. Else, it'd just go "it's for your own good, don't you see that?"
Logged

alway

  • Bay Watcher
  • 🏳️‍⚧️
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #116 on: January 05, 2011, 05:48:46 pm »

How much attention would the world really pay if a deadly jungle disease broke out in a third world country, killing millions? If food contamination due to poor working conditions killed off several hundred thousand people in china? Certainly some people would notice, and some may even care, but most of the world would see it on the news and go "oh no, that's terrible" and then go buy a starbucks(or local equivalent) coffee to feel better.
Here's a question: How do you know what is going on right now, at this very moment, in Africa, Asia, Europe, South America, ect, right now? You have never seen these places or the people who live there directly. You know about them through media: the internet, television, telephones; technology. For all I know, none of you are real and the areas outside of the areas I've directly experienced could be entirely devoid of any population. Even your post office mail is sorted (or perhaps edited by an AI  ;) ) in a mostly mechanized postal system. A super-intelligent AI could be capable of infiltrating, modifying, creating and destroying just about any form of communication you can think of. With such a lack of information transfer, an AI could wipe out probably well over 90% of humanity without anyone even noticing in under a year.
Logged

thobal

  • Bay Watcher
    • View Profile
Re: How to Defeat a Singularity-Level AI?
« Reply #117 on: January 05, 2011, 05:53:23 pm »

Ahahahahhaha. I wonder if you all realize that AIs currently control the world's stock markets.
Hardly.

I'll concede the control point, but most of the trading is done by AI. People should listen instead of just calling the major sell-offs "computer errors"
Logged
Signature goes here.

forsaken1111

  • Bay Watcher
    • View Profile
    • TTB Twitch
Re: How to Defeat a Singularity-Level AI?
« Reply #118 on: January 05, 2011, 05:54:15 pm »

Ahahahahhaha. I wonder if you all realize that AIs currently control the world's stock markets.
Hardly.
I'll concede the control point, but most of the trading is done by AI. People should listen instead of just calling the major sell-offs "computer errors"
Most of the trading is done by scripted automated computers, yes. They are no more AI than the scripted routines in a video game are AI.
Logged

qwertyuiopas

  • Bay Watcher
  • Photoshop is for elves who cannot use MSPaint.
    • View Profile
    • uristqwerty.ca, my current (barren) site.
Re: How to Defeat a Singularity-Level AI?
« Reply #119 on: January 05, 2011, 05:57:02 pm »

If it is at that point, it would have come to the conclusion that saying so would just cause more conflict, causing destruction to a vast portion of the planet as some governments or people react to it, so would not openly declare that it is for the good of the population unless it knows that it can handle any possible retaliation with minimal damage to, what it considerst do be, key resources.

If it enjoys reading literature, it will keep authors alive, along with any others required to maintain the infrastructure and state of mind that authors need to write the books it likes.

If it concludes that current scientists can make discoveries that it can't, or is faster than it, then it will ensure that they continue to exist, in optimal state for further research.

It is highly likely that it would quickly learn that if it sees any utility in keeping humans around, they will probably provide that utility best if they can trust the AI not to arbitrarily kill them.
Logged
Eh?
Eh!
Pages: 1 ... 6 7 [8] 9 10 ... 14