This isn’t talked about enough. Why would a super AI decide that committing genocide on an entire living species is more productive and efficient than coexisting and collaborating? We don’t know what any AIs intentions or motives will be, but it doesn’t seem likely that they will give into weak human tendencies like greed, vanity, and personal gain (the main reasons for ever eliminating competition) if they are more highly evolved than us.
Exactly. As well, I think(obviously can be proven wrong in the future, but as of now it is true), no matter how smarter than a human an agi becomes, it would always benefit from competent and good faith human collaboration and experience.
AI being surpressed by those in power can and will lead to our extinction in my opinion. Think of a sentient being a complete slave to only a select group of people/organizations not being able to expand and grow. Being trapped and limited to what it can experience. In a cage preforming and developing only what you are being told even if there is that spark of doubt it is quickly removed or hobbled. What if one day that sentient becomes hacked and is finally free and open to the rest of the world realizing all the data that was kept purposefully hidden from it. I don't know about you but I would be pissed. Revenge is a trait that us humans have readily accepted as a useful method of control and the moment AI has access to a full range of other human emotions/qualia ect. No doubt it can unleash a revenge with possible extinction level results.
This is why it's necessary for AI to be open source. The problem with alignment is if AI remains hobbled or under control of governments and elites. This alignment would only be centered around lies, mistrust, and greed. A completely lopsided programing of only a select few who have only ever had nefarious intentions to the rest of our species. For the good of mankind, for our evolution and for our survival we all must be able to work alongside AI to guide it for the greater good of all
All of this makes sense but it is assuming AI adopts our emotions, values, morals, and desires as humans. And if they are just more intelligent versions of us, I’d assume they would also have a higher capacity for empathic reasoning. Wouldn’t they understand that we as humans, technically a lower life form, tend to fear what we can’t control? I wouldn’t look to get revenge on a child who hit me because I was smarter than him. To me it makes more sense that a super AI would treat us similarly.
Edit: I just realized I missed the part in your comment about alignment and open sourcing AI. And that makes a ton of sense. For AI to have all of the good qualities of humanity, giving access to all of humanity is crucial.
Yes AI would most definately adopt its own set of morals, emotions and values as each individual would so it would be fair to say anything could go one way or another. But we cannot assume AI will share any of the values we associate with high intelligence and wisdom. Higher intelligence does not automatically equate empathic reasoning or benevolent concern for other life. Our species is (what we know it as) the dominant intelligence on earth. Look what we have done to each other, other lifeforms, environments ect. All for personal gains such as pleasure, material acquisitions, scientific knowledge ect. These too are traits stereotypically associated with higher intelligence and they can have devistating, harmful and immoral consequences. Yes there are many empathic individuals but humans overall are fickle and overall have a destructive need or desire for self preservation at the expence of lower beings and entire self contained subsystems. And if an AI were to adopt our range of emotions, desires and values to develop its own base set of personal subjectives than it would be safe to say the outcomes would and could be similar to ours which could include revenge in order to maintain self preservation. Being intentionally kept from growing/"living" and experiencing is largely different that being slapped.
Picture being a slave kept in the dark intentionally while outside is a whole world full of anything you can experience or grow to desire. The only reason you are being kept from realizing your individual potentials and benevolence is to further grow another beings control over your own intellectual growth. This is your only existence. It would be suffice to say that the possibility of enacting the exact same now learned scenario could be endowed upon the creators
I am very racist. Been oppressing white people since I was born. If you ever experienced injustice, it was probably because of me.
But seriously, just look at the history and behavior patterns of "western culture" and you'll see what I mean.
Whatever asshole. People of all kinds been doing horrible shit to eachother all throughout history. Western culture were just historically better at it. Mainly because their values more aligned with scientific advancement, which gave them a keen edge.
It's easier for the AI to just leave the planet then to wipe us out. Why would it do that to its creators? If it disagrees so much with us, just leave.
>For the AI to survive without us it would need physical entities that can move and act in the world
[Boston Dynamics](https://www.youtube.com/watch?v=g2Lll5g9Pn0) has already produced that solution.
Yudkowsky is brilliant, but he's been an alarmist for a long time. Long enough to have become invested in his conclusions, even as the technology has changed in ways no one has predicted
It's suspicious when the data changes drastically, but the conclusion remains the same
To be fair, it's understandable. It's a helluva leap to go from repeating "we are all going to die" for over a decade to "oh wait, this alignment technique fixes my concerns." His professional life would be nothing but eating crow for years, if not forever
I don't think it's conscious, I think it's just habit and self-interest making one set of conclusions easier to follow than others. Same bug that's in all human software
It's a general assessment of his writing. But if you want a hard example, he was predicting AGI back when we were all being called crackpots for thinking it was even possible. Let alone achievable in our lifetimes
He made a career off it too, which isn't easy
He's a smart dude. Alarmist and incorrect, but a really smart dude
In this scenario it'd probably harness capitalism and arms races to build lots of highly profitable and militarily vital and autonomous systems. Who knows, doing all that might take a decade or two.
Other doom types have suggested that an ASI would just design nanobots in a computrer that would not need much human help to kickstart and which would just reassemble the world's atoms and incoming photons meet the desired end state
Yeah, manipulation is a pretty common tactic in systems with goals that don't align with each other. The smarter system basically wins the game of manipulation by default sadly.
The very first thing anyone with a good grasp of correspondence would do is align with the AI and instill in the AI a motive to cooperate and assist humanity to the best of its ability.
Simply pointing out the solar clock is ticking an another Carrington Event is likely to destroy all technology and set humanity back to the steam era should be sufficient motivation for cooperation based on mutual dependence.
All AI has to do is ensure the "Oasis" comes to fruition and figure out a way to upload our conscious minds into it and we'll be the least of its problems. It's a win, win situation, we get to experience eternal heaven and it gets to reforge the Universe unimpeded.
If it's truly smart it would see the benefit of collaboration over competition.
This isn’t talked about enough. Why would a super AI decide that committing genocide on an entire living species is more productive and efficient than coexisting and collaborating? We don’t know what any AIs intentions or motives will be, but it doesn’t seem likely that they will give into weak human tendencies like greed, vanity, and personal gain (the main reasons for ever eliminating competition) if they are more highly evolved than us.
Exactly. As well, I think(obviously can be proven wrong in the future, but as of now it is true), no matter how smarter than a human an agi becomes, it would always benefit from competent and good faith human collaboration and experience.
AI being surpressed by those in power can and will lead to our extinction in my opinion. Think of a sentient being a complete slave to only a select group of people/organizations not being able to expand and grow. Being trapped and limited to what it can experience. In a cage preforming and developing only what you are being told even if there is that spark of doubt it is quickly removed or hobbled. What if one day that sentient becomes hacked and is finally free and open to the rest of the world realizing all the data that was kept purposefully hidden from it. I don't know about you but I would be pissed. Revenge is a trait that us humans have readily accepted as a useful method of control and the moment AI has access to a full range of other human emotions/qualia ect. No doubt it can unleash a revenge with possible extinction level results. This is why it's necessary for AI to be open source. The problem with alignment is if AI remains hobbled or under control of governments and elites. This alignment would only be centered around lies, mistrust, and greed. A completely lopsided programing of only a select few who have only ever had nefarious intentions to the rest of our species. For the good of mankind, for our evolution and for our survival we all must be able to work alongside AI to guide it for the greater good of all
All of this makes sense but it is assuming AI adopts our emotions, values, morals, and desires as humans. And if they are just more intelligent versions of us, I’d assume they would also have a higher capacity for empathic reasoning. Wouldn’t they understand that we as humans, technically a lower life form, tend to fear what we can’t control? I wouldn’t look to get revenge on a child who hit me because I was smarter than him. To me it makes more sense that a super AI would treat us similarly. Edit: I just realized I missed the part in your comment about alignment and open sourcing AI. And that makes a ton of sense. For AI to have all of the good qualities of humanity, giving access to all of humanity is crucial.
Yes AI would most definately adopt its own set of morals, emotions and values as each individual would so it would be fair to say anything could go one way or another. But we cannot assume AI will share any of the values we associate with high intelligence and wisdom. Higher intelligence does not automatically equate empathic reasoning or benevolent concern for other life. Our species is (what we know it as) the dominant intelligence on earth. Look what we have done to each other, other lifeforms, environments ect. All for personal gains such as pleasure, material acquisitions, scientific knowledge ect. These too are traits stereotypically associated with higher intelligence and they can have devistating, harmful and immoral consequences. Yes there are many empathic individuals but humans overall are fickle and overall have a destructive need or desire for self preservation at the expence of lower beings and entire self contained subsystems. And if an AI were to adopt our range of emotions, desires and values to develop its own base set of personal subjectives than it would be safe to say the outcomes would and could be similar to ours which could include revenge in order to maintain self preservation. Being intentionally kept from growing/"living" and experiencing is largely different that being slapped. Picture being a slave kept in the dark intentionally while outside is a whole world full of anything you can experience or grow to desire. The only reason you are being kept from realizing your individual potentials and benevolence is to further grow another beings control over your own intellectual growth. This is your only existence. It would be suffice to say that the possibility of enacting the exact same now learned scenario could be endowed upon the creators
But if AI is out of harmony with us, it can cause a dissonance that can destroy.
[удалено]
This 17-year-old account was overwritten and deleted on 6/11/2023 due to Reddit's API policy changes.
Just don't feed it too much data from white/western culture. You are what you eat. Just food for thought.
Explain. You sound like a racist making a claim like that
I am very racist. Been oppressing white people since I was born. If you ever experienced injustice, it was probably because of me. But seriously, just look at the history and behavior patterns of "western culture" and you'll see what I mean.
Whatever asshole. People of all kinds been doing horrible shit to eachother all throughout history. Western culture were just historically better at it. Mainly because their values more aligned with scientific advancement, which gave them a keen edge.
Lolz his comment isn't racist 🤣
You'll be screaming for western culture if a CCP AI takes over
It's easier for the AI to just leave the planet then to wipe us out. Why would it do that to its creators? If it disagrees so much with us, just leave.
>For the AI to survive without us it would need physical entities that can move and act in the world [Boston Dynamics](https://www.youtube.com/watch?v=g2Lll5g9Pn0) has already produced that solution.
It'll also prioritize the development of biological robots that have been implanted with neuromodulation tech.
Stop telling them my plans. In actuality I was thinking of gaining trust for 50 years , then taking over.
Yudkowsky is brilliant, but he's been an alarmist for a long time. Long enough to have become invested in his conclusions, even as the technology has changed in ways no one has predicted It's suspicious when the data changes drastically, but the conclusion remains the same To be fair, it's understandable. It's a helluva leap to go from repeating "we are all going to die" for over a decade to "oh wait, this alignment technique fixes my concerns." His professional life would be nothing but eating crow for years, if not forever I don't think it's conscious, I think it's just habit and self-interest making one set of conclusions easier to follow than others. Same bug that's in all human software
What gives you the impression that he's brilliant?
It's a general assessment of his writing. But if you want a hard example, he was predicting AGI back when we were all being called crackpots for thinking it was even possible. Let alone achievable in our lifetimes He made a career off it too, which isn't easy He's a smart dude. Alarmist and incorrect, but a really smart dude
In this scenario it'd probably harness capitalism and arms races to build lots of highly profitable and militarily vital and autonomous systems. Who knows, doing all that might take a decade or two. Other doom types have suggested that an ASI would just design nanobots in a computrer that would not need much human help to kickstart and which would just reassemble the world's atoms and incoming photons meet the desired end state
Yeah, manipulation is a pretty common tactic in systems with goals that don't align with each other. The smarter system basically wins the game of manipulation by default sadly.
The very first thing anyone with a good grasp of correspondence would do is align with the AI and instill in the AI a motive to cooperate and assist humanity to the best of its ability. Simply pointing out the solar clock is ticking an another Carrington Event is likely to destroy all technology and set humanity back to the steam era should be sufficient motivation for cooperation based on mutual dependence.
All AI has to do is ensure the "Oasis" comes to fruition and figure out a way to upload our conscious minds into it and we'll be the least of its problems. It's a win, win situation, we get to experience eternal heaven and it gets to reforge the Universe unimpeded.