“Why give a robot an order to obey orders—why aren't the original orders enough? Why command a robot not to do harm—wouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (…) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence—like vision, motor coordination, and common sense—does not come free with computation but has to be programmed in. (…) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!”

Steven Pinker
Time Dreams Courage Challenging

Explore This Quote Further

Quote by Steven Pinker: “Why give a robot an order to obey orders—why are… - Image 1

Similar quotes

“Thinking is computation, I claim, but that does not mean that the computer is a good metaphor for the mind. The mind is a set of modules, but the modules are not encapsulated boxes or circumscribed swatches on the surface of the brain. The organization of our mental modules comes from our genetic program, but that does not mean that there is a gene for every trait or that learning is less important than we used to think. The mind is an adaptation designed by natural selection, but that does not mean that everything we think, feel, and do is biologically adaptive. We evolved from apes, but that does not mean we have the same minds as apes. And the ultimate goal of natural selection is to propagate genes, but that does not mean that the ultimate goal of people is to propagate genes.”


“The Rights Revolutions too have given us ideals that educated people today take for granted but that are virtually unprecedented in human history, such as that people of all races and creeds have equal rights, that women should be free from all forms of coercion, that children should never, ever be spanked, that students should be protected from bullying, and that there’s nothing wrong with being gay. I don’t find it at all implausible that these are gifts, in part, of a refined and widening application of reason.”


“The Three Laws of Robotics:1: A robot may not injure a human being or, through inaction, allow a human being to come to harm;2: A robot must obey the orders given it by human beings except where such orders would conflict with the First Law;3: A robot must protect its own existence as long as such protection does not conflict with the First or Second Law;The Zeroth Law: A robot may not harm humanity, or, by inaction, allow humanity to come to harm.”


“Though many of my arguments will be coolly analytical — that an acknowledgment of human nature does not, logically speaking, imply the negative outcomes so many people fear — I will not try to hide my belief that they have a positive thrust as well. "Man will become better when you show him what he is like," wrote Chekhov, and so the new sciences of human nature can help lead the way to a realistic, biologically informed humanism. They expose the psychological unity of our species beneath the superficial differences of physical appearance and parochial culture. They make us appreciate the wondrous complexity of the human mind, which we are apt to take for granted precisely because it works so well. They identify the moral intuitions that we can put to work in improving our lot. They promise a naturalness in human relationships, encouraging us to treat people in terms of how they do feel rather than how some theory says they ought to feel. They offer a touchstone by which we can identify suffering and oppression wherever they occur, unmasking the rationalizations of the powerful. They give us a way to see through the designs of self-appointed social reformers who would liberate us from our pleasures. They renew our appreciation for the achievements of democracy and of the rule of law. And they enhance the insights of artists and philosophers who have reflected on the human condition for millennia.”


“Everyone has a theory of human nature. Everyone has to anticipate the behavior of others, and that means we all need theories about what makes people tick.”


“The problem with the religious solution [for mysteries such as consciousness and moral judgments] was stated by Mencken when he wrote, "Theology is the effort to explain the unknowable in terms of the not worth knowing." For anyone with a persistent intellectual curiosity, religious explanations are not worth knowing because they pile equally baffling enigmas on top of the original ones. What gave God a mind, free will, knowledge, certainty about right and wrong? How does he infuse them into a universe that seems to run just fine according to physical laws? How does he get ghostly souls to interact with hard matter? And most perplexing of all, if the world unfolds according to a wise and merciful plan, why does it contain so much suffering? As the Yiddish expression says, If God lived on earth, people would break his window.”