HOUSE_OVERSIGHT_013149.jpg

2.31 MB
View Original

Extraction Summary

1
People
2
Organizations
0
Locations
0
Events
1
Relationships
3
Quotes

Document Information

Type: Academic text / book page (included in government oversight file)
File Size: 2.31 MB
Summary

This document is page 233 of an academic text regarding Artificial General Intelligence (AGI). It discusses the differences between 'Coherent Extrapolated Volition' (CEV) and 'Coherent Blended Volition,' arguing for human collaboration mediated by 'Global Brain technologies' over machine optimization. It also explores Stephen Omohundro's arguments regarding the safety benefits of creating a society of interacting AGIs rather than a single entity to mitigate risks, while acknowledging the dangers of a 'hard takeoff.' The page bears a House Oversight Bates stamp.

People (1)

Name Role Context
Stephen Omohundro Researcher / Author
Cited in the text regarding game-theoretic dynamics and AGI populations.

Organizations (2)

Name Type Context
Singularity Institute
Referenced in the footnote URL (singinst.org).
House Oversight Committee
Inferred from the Bates stamp 'HOUSE_OVERSIGHT'.

Relationships (1)

Stephen Omohundro Academic Citation Author (Unspecified)
Author cites Omohundro's argument regarding interacting AGI systems.

Key Quotes (3)

"The core difference between the two approaches is that in the CEV vision, the extrapolation and coherentization are to be done by a highly intelligent, highly specialized software program, whereas in the approach suggested here, these are to be carried out by collective activity of humans as mediated by Global Brain technologies."
Source
HOUSE_OVERSIGHT_013149.jpg
Quote #1
"Roughly speaking, if one has a society of AGIs rather than a single AGI, and all the members of the society share roughly similar ethics, then if one AGI starts to go "off the rails", its compatriots will be in a position to correct its behavior."
Source
HOUSE_OVERSIGHT_013149.jpg
Quote #2
"Of course, a society of AGIs is no protection against a single member undergoing a "hard takeoff" and drastically accelerating its intelligence simultaneously with shifting its ethical principles."
Source
HOUSE_OVERSIGHT_013149.jpg
Quote #3

Discussion 0

Sign in to join the discussion

No comments yet

Be the first to share your thoughts on this epstein document