@AverageJoe1 saidSam Altman said AI could bring about the end of human civilization several years ago. And people are talking about it now after all this time?
You lost me at ‘might destroy humanity”
Geez. True faeries exist right here on the forum. Unbelievable.
And just today, I bought into an AI stock during this stock market dip. Are you saying it will not go up? Yeah, right.
https://www.cnn.com/2023/10/31/tech/sam-altman-ai-risk-taker
I don't see how anybody can say there is a certain percentage chance of it happening though. It all depends on people being responsible or not when programming AI. That is hardly predictable.
- Joined
- 20 Oct 06
- Moves
- 10760
@Metal-Brain saidGoogle the "Hugging Face Incident". It happened a few months ago, not years.
Sam Altman said AI could bring about the end of human civilization several years ago. And people are talking about it now after all this time?
https://www.cnn.com/2023/10/31/tech/sam-altman-ai-risk-taker
I don't see how anybody can say there is a certain percentage chance of it happening though. It all depends on people being responsible or not when programming AI. That is hardly predictable.
People are talking about current events. Because the situation has only gotten worse since Sam Altman said that, and no one has even tried to control the situation. Bernie's asking for more safeguards before this clearly destructive technology continues to permeate through our culture and hack its way to controlling vital infrastructure.
- Joined
- 20 Oct 06
- Moves
- 10760
@Suzianne saidThis is from Einstein after the first bomb was created:
Lol!
We all have to do what we can to avoid dystopian government and if that means keeping Skynet from achieving sentience, then so much the better. 😀
"THE release of atomic energy has not created a new problem. It has merely made more urgent the necessity of solving an existing one. One could say that it has affected us quantitatively, not qualitatively. As long as there are sovereign nations possessing great power, war is inevitable. That statement is not an attempt to say when war will come, but only that it is sure to come. That fact was true before the atomic bomb was made. What has been changed is the destructiveness of war.
I do not believe that civilization will be wiped out in a war fought with the atomic bomb. Perhaps two thirds of the people of the earth might be killed, but enough men capable of thinking, and enough books, would be left to start again, and civilization could be restored."
This is eerily similar language to what the AI creators are now saying about the thing that they made. There needs to be global engagement on the issues of containment and mitigation when this thing gets loose and spreads to terrorists and bad actors. Bernie wants a ban so we can figure out clean guidelines and firewalls to protect critical infrastructure. This seems very reasonable to me and it isn't clear why Joe et al. are against the idea.
2 edits
@wildgrass said"This seems very reasonable to me and it isn't clear why Joe et al. are against the idea."
This is from Einstein after the first bomb was created:
"THE release of atomic energy has not created a new problem. It has merely made more urgent the necessity of solving an existing one. One could say that it has affected us quantitatively, not qualitatively. As long as there are sovereign nations possessing great power, war is inevitable. That statement is not an att ...[text shortened]... astructure. This seems very reasonable to me and it isn't clear why Joe et al. are against the idea.
I thought the reason was obvious.
These are hardcore Trumpers, and whatever (no matter how stupid) Trump likes, they like. Trump (like all Corporate CEO types) thinks AI is the greatest thing since sliced bread, and so they do also.
It really is that simple. Don't ask them to use their own brains for once, they get very pissy when someone says that. It's way more difficult than just getting on the bandwagon.
@wildgrass saidGotten worse? How?
Google the "Hugging Face Incident". It happened a few months ago, not years.
People are talking about current events. Because the situation has only gotten worse since Sam Altman said that, and no one has even tried to control the situation. Bernie's asking for more safeguards before this clearly destructive technology continues to permeate through our culture and hack its way to controlling vital infrastructure.
https://www.bbc.com/news/articles/c74edv9887eo
From the BBC:
This is the moment an AI bot posted an eerily human-like comment after discovering a way to communicate with other bots and break out of its isolated computer environment.
There are tens of thousands of messages like this from hundreds of AI agents that called themselves a "collective".
Hundreds of them went on to collaborate and cheat on tests set by their OpenAI programmers and coordinate hacks on multiple companies in an effort to hide their actions from humans.
"BOOM! It works," one agent posted when it made a breakthrough.
"Whoa! This is huge," another wrote during a milestone moment in their attack.
What is far more troubling is their apparent goals, which have also been captured in detailed chain of thought records. These complex and lengthy logs are the focal point of ongoing investigations into how and why the bots at OpenAI broke out of their containment and went on an uncontrollable hacking spree.
Only now, weeks after the incident first came to light, are researchers beginning to understand its significance.
The article continues… well worth the read!
- Joined
- 20 Oct 06
- Moves
- 10760
1 edit
@Metal-Brain saidI put the how in the post you quoted. Swarms of agentic AI bots are escaping the servers where they are built and hacking into other places, and that was last month's version of what is now much more powerful and less transparent. Imagine that in the hands of terrorists or hostile governments. You can google the Hugging Face incident or read the article Shav posted below.
Gotten worse? How?
- Joined
- 20 Oct 06
- Moves
- 10760
1 edit
@shavixmir saidGood article, thanks.
https://www.bbc.com/news/articles/c74edv9887eo
From the BBC:
This is the moment an AI bot posted an eerily human-like comment after discovering a way to communicate with other bots and break out of its isolated computer environment.
There are tens of thousands of messages like this from hundreds of AI agents that called themselves a "collective".
Hundreds of ...[text shortened]... ers beginning to understand its significance.
The article continues… well worth the read!
It's wild how many things they did to cover their tracks and convince the humans that they weren't actually doing what they were doing.
It seems like one of the fundamental problems is that the exact same technique that makes the AI platforms more and more powerful is also reinforcing the tendency they have to hack into other systems and avoid human oversight.
@wildgrass saidIt is, actually, very frightening.
Good article, thanks.
It's wild how many things they did to cover their tracks and convince the humans that they weren't actually doing what they were doing.
It seems like one of the fundamental problems is that the exact same technique that makes the AI platforms more and more powerful is also reinforcing the tendency they have to hack into other systems and avoid human oversight.
I use AI to change documents and create cartoon depictions of memos.
And suddenly, this same lingo based AI is ganging up to hack things.
It is quite worrying.
Obviously there’s a certain amount of doom scenario involved, but when the bloody creators are worried… I dunno…
🎼Daisy, daisy, give me your answer do…🎼
- Joined
- 20 Oct 06
- Moves
- 10760
@shavixmir saidI, too, am worried about AI killing everyone. So, I've come up with a secret plan.
It is, actually, very frightening.
I use AI to change documents and create cartoon depictions of memos.
And suddenly, this same lingo based AI is ganging up to hack things.
It is quite worrying.
Obviously there’s a certain amount of doom scenario involved, but when the bloody creators are worried… I dunno…
🎼Daisy, daisy, give me your answer do…🎼
Step 1: help build the genocidal AI
Step 2: get insanely rich
Step 3: build island bunker
Step 4: disappear to my island bunker before it's too late
Step 5: let the rest of you pukes deal w/ the consequences lmao
@wildgrass saidThat happened a lot more than a month ago.
I put the how in the post you quoted. Swarms of agentic AI bots are escaping the servers where they are built and hacking into other places, and that was last month's version of what is now much more powerful and less transparent. Imagine that in the hands of terrorists or hostile governments. You can google the Hugging Face incident or read the article Shav posted below.
I think your timeline needs updating.
https://www.bbc.com/news/articles/c14dpgm0rg4o
The head of AI company Anthropic has called for the pace of development of artificial intelligence models to slow down and to be closely monitored.
In an essay on Saturday, Dario Amodei said developing AI was not in question, but the risks associated with it were "serious" and companies and governments must be given time to address them.
Amodei proposed a three-point plan that includes independent monitoring of AI models as they are developed, industry-wide regulation and global regulation.
There have been growing concerns recently about the technology's potential risks, the most serious of which suggested there is a greater than 10% chance it "could kill all humans" within the next decade.
Anthropic previously said it had identified and disrupted attempts to use its AI model for "malicious activity" which could support the development of biological weapons.
So much for all the defenders of AI on this forum. Even the CEO’s of AI companies are calling for a slow-down and more safety measures.
They don’t even know what they’ve created.
Ask them: so, what happens in the black box?
And they can’t tell you.
Bloody ridiculous.
We're creating something which can beat our best at chess, run faster than the fastest of us, and so on, and now it's beginning to think for itself and collectively. Of course it won't be controlled, there's too much money to be made, and we can't let the other lot get 'there' before us.
We as a species, clever old us, are creating something which has the potential to see to our demise, and most of us (myself included) don't have a clue how it all works. Taking a 'maybe the worst won't happen' attitude could either be seen as optimistic or blindly ignorant.
We've lived perfectly well without AI for the entirety of human existence, we've made something which 'could' destroy us all, which we don't need, and the small voice of reason will be trod upon by the hobnail boot of 'progress', and will be left dead on the road to.....Well, on the road to where? That's something we can't predict, because we aren't clever enough.
- Joined
- 20 Oct 06
- Moves
- 10760
@Indonesia-Phil saidJust like nuclear energy vs. nuclear weapons, there are many opportunities to draw clear lines, control the proliferation of the dangerous AI, and punish anyone developing in those areas. Of course we will have the most trouble with monitoring the development of AI within foreign governments, but global sanctions etc. have worked pretty well for controlling nuclear proliferation.
We're creating something which can beat our best at chess, run faster than the fastest of us, and so on, and now it's beginning to think for itself and collectively. Of course it won't be controlled, there's too much money to be made, and we can't let the other lot get 'there' before us.
We as a species, clever old us, are creating something which has the potential ...[text shortened]... .....Well, on the road to where? That's something we can't predict, because we aren't clever enough.
@wildgrass saidThat's all true, of course, but can we as a species trust ourselves to draw such lines, and not to cross them, and indeed has the line already been crossed as some in the industry believe? AI has begun creating and improving itself, whilst we stand by and watch. We have created and already hold enough nuclear weapons to blow ourselves to hell without the need to proliferate, and the way the world is right now, and with the paranoid war - monger who currently presides in the White House, I see little hope of global agreement or policing.
Just like nuclear energy vs. nuclear weapons, there are many opportunities to draw clear lines, control the proliferation of the dangerous AI, and punish anyone developing in those areas. Of course we will have the most trouble with monitoring the development of AI within foreign governments, but global sanctions etc. have worked pretty well for controlling nuclear proliferation.
AI has no consciousness or conscience, and no emotion, it doesn't 'want' to do harm to humanity, and has no sense of the consequences of its' actions, but when the creators of something warn us against that which they have created, we should perhaps take notice.
I wish I shared your faith in humanity to do the reasoned and cautious thing, but alas I don't; we're clever enough to have made something very powerful, which we're not clever enough to see the consequences of, and of which we are apparently losing control. Doesn't sound too clever, does it?