“In fact, without a specification of a creature's goals, the very idea of intelligence is meaningless. A toadstool could be given a genius award for accomplishing with pinpoint precision and unerring reliability, the feat of sitting exactly where it is sitting. Nothing would prevent us from agreeing with the cognitive scientist Zenon Pylyshyn that rocks are smarter than cats because rocks have the sense to go away when you kick them.”

“Challenge a person's beliefs, and you challenge his dignity, standing, and power. And when those beliefs are based on nothing but faith, they are chronically fragile. No one gets upset about the belief that rocks fall down as opposed to up, because all sane people can see it with their own eyes. Not so for the belief that babies are born with original sin or that God exists in three persons or that Ali is the second-most divinely inspired man after Muhammad. When people organize their lives around these beliefs, and then learn of other people who seem to be doing just fine without them--or worse, who credibly rebut them--they are in danger of looking like fools. Since one cannot defend a belief based on faith by persuading skeptics it is true, the faithful are apt to react to unbelief with rage, and may try to eliminate that affront to everything that makes their lives meaningful.”

“One can choose to obsess over prescriptive rules, but they have no more to do with human language than the criteria for judging cats at a cat show have to do with mammalian biology.”

“Why give a robot an order to obey orders—why aren't the original orders enough? Why command a robot not to do harm—wouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (…) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence—like vision, motor coordination, and common sense—does not come free with computation but has to be programmed in. (…) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!”

“The Rights Revolutions too have given us ideals that educated people today take for granted but that are virtually unprecedented in human history, such as that people of all races and creeds have equal rights, that women should be free from all forms of coercion, that children should never, ever be spanked, that students should be protected from bullying, and that there’s nothing wrong with being gay. I don’t find it at all implausible that these are gifts, in part, of a refined and widening application of reason.”

“The universality of reason is a momentous realization, because it defines a place for morality. If I appeal to you do do something that affects me—to get off my foot, or not to stab me for the fun of it, or to save my child from drowning—then I can't do it in a way that privileges my interests of yours if I want you to take me seriously (say, by retaining my right to stand on your foot, or to stab you, or to let your children drown). I have to state my case in a way that would force me to treat you in kind. I can't act as if my interests are special just because I'm me and you're not, any more than I can persuade you that the spot I am standing on is a special place in the universe just because I happen to be standing on it.You and I ought to reach this moral understanding not just so we can have a logically consistent conversation but because mutual unselfishness is the only way we can simultaneously pursue our interests. You and I are both better off if we share our surpluses, rescue each other's children when they get into trouble, and refrain from knifing each other than we would be if we hoarded our surpluses while they rotted, let each other's children drown, and feuded incessantly. Granted, I might be a bit better off if I acted selfishly at your expense and you played the sucker, but the same is true for you with me, so if each of us tried for these advantages, we'd both end up worse off. Any neutral observer, and you and I if we could talk it over rationally, would have to conclude that the state we should aim for is the one where we both are unselfish.Morality, then, is not a set of arbitrary regulations dictated by a vengeful deity and written down in a book; nor is it the custom of a particular culture or tribe. It is a consequence of the interchangeability of perspectives and the opportunity the world provides for positive-sum games.”

“Evolutionarily speaking, there is seldom any mystery in why we seek the goals we seek — why, for example, people would rather make love with an attractive partner than get a slap on the belly with a wet fish.”