From TheBestLinks.com
Creating Friendly artificial intelligence (often abbreviated FAI) is an issue at the intersection of ethics and artificial intelligence (AI) research.
Friendliness theory has been developed as a model for creating safe, moral AI. This theory has been developed by Eliezer Yudkowsky.
The theory starts from the supposition that, in the future, AIs with intellectual and practical abilites vastly superior to humans will be created, or rather will create themselves from seed AI (a belief common in transhumanism and, obviously, Singularitarianism). The problem then becomes how these AIs will behave with human beings, and if they will have a morality (if any) similar to ours. The difference in power between the AIs and humans will be so great that, in Yudkowsky's words, "if the AI stops wanting to be Friendly, you've already lost". The AIs' ability to reprogram themselves will quickly outpace the humans' ability to control them. If they do not actively desire to remain Friendly, even if they are indifferent, the possibility that they may become unFriendly is a risk unacceptable to humans.
Proponents of Friendliness theory make the analogy of raising a teenager; until that person is legally responsible, the parent is responsible for its well-being and for maintaining control and monitoring safety of its actions, and negotiating privileges. Friendliness toward a person goes a long way toward earning their respect; tyranny creates resentment, and causes secretive behaviour.
Critics of the theory point out that there is a political process involved and that the Technological Singularity will completely transform power relations in society, straining the analogy. They further point out that governments and corporations will not be motivated to produce Friendly AIs, and that there are serious flaws in the models.
Capitalization
The word "Friendliness", starting with a capital F, is a technical term and completely separate from the English word "friendliness" that starts with a lowercase F. The word is capitalized in technical usage specifically to both differentiate from "friendliness" and to allow everyone else to continue to use "friendliness" as they always have, aware or not of the technical use of "Friendliness".
External links
Related links
Top visited
0 of
0 links
[no links posted yet]
>> place link >>
Discussion
Last posted
0 of
0 messages
[no messages posted yet]
>> post message >>
Watch
You can
add this article to your own "watchlist" and receive e-mail notification about all changes in this page.
