“Here’s how Chalmers describes this vision (starting at 22:27 in Youtube video below):
“For me, that raising the possibility of a massive failure mode in the future, the possibility that we create human or super human level AGI and we’ve got a whole world populated by super human level AGIs, none of whom is conscious. And that would be a world, could potentially be a world of great intelligence, no consciousness no subjective experience at all. Now, I think many many people, with a wide variety of views, take the view that basically subjective experience or consciousness is required in order to have any meaning or value in your life at all. So therefore, a world without consciousness could not possibly a positive outcome. maybe it wouldn’t be a terribly negative outcome, it would just be a 0 outcome, and among the worst possible outcomes.”
Chalmers is known for his work on the philosophy of mind and has delved particularly into the nature of consciousness. He famously formulated the idea of a “hard problem of consciousness” which he describes in his 1995 paper “Facing up to the problem of consciousness” as the question of ”why does the feeling which accompanies awareness of sensory information exist at all?””
Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness
https://bigthink.com/the-future/automation-nightmare-we-might-be-headed-for-a-world-without-consciousness/
via Instapaper
“For me, that raising the possibility of a massive failure mode in the future, the possibility that we create human or super human level AGI and we’ve got a whole world populated by super human level AGIs, none of whom is conscious. And that would be a world, could potentially be a world of great intelligence, no consciousness no subjective experience at all. Now, I think many many people, with a wide variety of views, take the view that basically subjective experience or consciousness is required in order to have any meaning or value in your life at all. So therefore, a world without consciousness could not possibly a positive outcome. maybe it wouldn’t be a terribly negative outcome, it would just be a 0 outcome, and among the worst possible outcomes.”
Chalmers is known for his work on the philosophy of mind and has delved particularly into the nature of consciousness. He famously formulated the idea of a “hard problem of consciousness” which he describes in his 1995 paper “Facing up to the problem of consciousness” as the question of ”why does the feeling which accompanies awareness of sensory information exist at all?””
Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness
https://bigthink.com/the-future/automation-nightmare-we-might-be-headed-for-a-world-without-consciousness/
via Instapaper
