Eliezer Yudkowsky photo

Eliezer Yudkowsky

From Wikipedia:

Eliezer Shlomo Yudkowsky is an American artificial intelligence researcher concerned with the singularity and an advocate of friendly artificial intelligence, living in Redwood City, California.

Yudkowsky did not attend high school and is an autodidact with no formal education in artificial intelligence. He co-founded the nonprofit Singularity Institute for Artificial Intelligence (SIAI) in 2000 and continues to be employed as a full-time Research Fellow there.

Yudkowsky's research focuses on Artificial Intelligence theory for self-understanding, self-modification, and recursive self-improvement (seed AI); and also on artificial-intelligence architectures and decision theories for stably benevolent motivational structures (Friendly AI, and Coherent Extrapolated Volition in particular). Apart from his research work, Yudkowsky has written explanations of various philosophical topics in non-academic language, particularly on rationality, such as "An Intuitive Explanation of Bayes' Theorem".

Yudkowsky was, along with Robin Hanson, one of the principal contributors to the blog Overcoming Bias sponsored by the Future of Humanity Institute of Oxford University. In early 2009, he helped to found Less Wrong, a "community blog devoted to refining the art of human rationality". The Sequences on Less Wrong, comprising over two years of blog posts on epistemology, Artificial Intelligence, and metaethics, form the single largest bulk of Yudkowsky's writing.


“‎If you regard evidence as a constraint and seek to free yourself, you sell yourself into the chains of your whims. For you cannot make a true map of a city by sitting in your bedroom with your eyes shut and drawing lines upon paper according to impulse.”
Eliezer Yudkowsky
Read more
“Do not think that fairness to all sides means balancing yourself evenly between positions; truth is not handed out in equal portions before the start of a debate.”
Eliezer Yudkowsky
Read more
“If the box contains a diamond,I desire to believe that the box contains a diamond;If the box does not contain a diamond,I desire to believe that the box does not contain a diamond;Let me not become attached to beliefs I may not want.”
Eliezer Yudkowsky
Read more
“Lies propagate, that's what I'm saying. You've got to tell more lies to cover them up, lie about every fact that's connected to the first lie. And if you kept on lying, and you kept on trying to cover it up, sooner or later you'd even have to start lying about the general laws of thought. Like, someone is selling you some kind of alternative medicine that doesn't work, and any double-blind experimental study will confirm that it doesn't work. So if someone wants to go on defending the lie, they've got to get you to disbelieve in the experimental method. Like, the experimental method is just for merely scientific kinds of medicine, not amazing alternative medicine like theirs. Or a good and virtuous person should believe as strongly as they can, no matter what the evidence says. Or truth doesn't exist and there's no such thing as objective reality. A lot of common wisdom like that isn't just mistaken, it's anti-epistemology, it's systematically wrong. Every rule of rationality that tells you how to find the truth, there's someone out there who needs you to believe the opposite. If you once tell a lie, the truth is ever after your enemy; and there's a lot of people out there telling lies.”
Eliezer Yudkowsky
Read more
“I see little hope for democracy as an effective form of government, but I admire the poetry of how it makes its victims complicit in their own destruction.”
Eliezer Yudkowsky
Read more
“You will find ambiguity a great ally on your road to power. Give a sign of Slytherin on one day, and contradict it with a sign of Gryffindor the next; and the Slytherins will be enabled to believe what they wish, while the Gryffindors argue themselves into supporting you as well. So long as there is uncertainty, people can believe whatever seems to be to their own advantage. And so long as you appear strong, so long as you appear to be winning, their instincts will tell them that their advantage lies with you. Walk always in the shadow, and light and darkness both will follow.”
Eliezer Yudkowsky
Read more
“Existential depression has always annoyed me; it is one of the world's most pointless forms of suffering.”
Eliezer Yudkowsky
Read more
“Mr. Malfoy is new to the business of having ideas, and so when he has one, he becomes proud of himself for having it. He has not yet had enough ideas to unflinchingly discard those that are beautiful in some aspects and impractical in others; he has not yet acquired confidence in his own ability to think of better ideas as he requires them. What we are seeing here is not Mr. Malfoy's best idea, I fear, but rather his only idea.”
Eliezer Yudkowsky
Read more
“For an instant Harry imagined... Just for an instant, before his imagination blew a fuse and called an emergency shut down and told him never to imagine that again.”
Eliezer Yudkowsky
Read more
“It's a most peculiar psychology—this business of 'Science is based on faith too, so there!' Typically this is said by people who claim that faith is a good thing. Then why do they say 'Science is based on faith too!' in that angry-triumphal tone, rather than as a compliment? And a rather dangerous compliment to give, one would think, from their perspective. If science is based on 'faith', then science is of the same kind as religion—directly comparable. If science is a religion, it is the religion that heals the sick and reveals the secrets of the stars. It would make sense to say, 'The priests of science can blatantly, publicly, verifiably walk on the Moon as a faith-based miracle, and your priests' faith can't do the same.' Are you sure you wish to go there, oh faithist? Perhaps, on further reflection, you would prefer to retract this whole business of 'Science is a religion too!”
Eliezer Yudkowsky
Read more
“...if you're unhappy whenever other people don't picture you exactly the same way you picture yourself, that's already dooming yourself to always be unhappy. No one ever thinks of us just the same way we think of ourselves.”
Eliezer Yudkowsky
Read more
“Not every change is an improvement but every improvement is a change; you can't do anything BETTER unless you can manage to do it DIFFERENTLY, you've got to let yourself do better than other people!”
Eliezer Yudkowsky
Read more
“...there's something in science like the shine of the Patronus Charm, driving back all sorts of darkness and madness...”
Eliezer Yudkowsky
Read more
“What people really believe doesn't feel like a BELIEF, it feels like the way the world IS.”
Eliezer Yudkowsky
Read more
“Trying and getting hurt can't possibly be worse for you than being... stuck.”
Eliezer Yudkowsky
Read more
“Many have stood their ground and faced the darkness when it comes for them. Fewer come for the darkness and force it to face them.”
Eliezer Yudkowsky
Read more
“There were mysterious questions, but a mysterious answer was a contradiction in terms.”
Eliezer Yudkowsky
Read more
“Aside from helping people with their homework, or anything else they needed, she really didn't know how to meet people. She didn't feel like she was a shy person. She thought of herself as a take-charge sort of girl. And yet, somehow, if there wasn't some request along the lines of "I can't remember how to do long division" then it was just too awkward to go up to someone and say... what? She'd never been able to figure out what. And there didn't seem to be a standard information sheet, which was ridiculous. The whole business of meeting people had never seemed sensible to her. Why did she have to take all the responsibility herself when there were two people involved? Why didn't adults ever help? She wished some other girl would just walk up to her and say, "Hermione, the teacher told me to be friends with you".”
Eliezer Yudkowsky
Read more
“- With respect, Professor McGonagall, I'm not quite sure you understand what I'm trying to do here.- With respect, Mr. Potter, I'm quite sure I don't. Unless - this is a guess, mind - you're trying to take over the world?- No! I mean yes - well, NO!- I think i should perhaps be alarmed that you have trouble answering the question.”
Eliezer Yudkowsky
Read more
“I'm wondering if there's a spell to make lightning flash in the background whenever I make an ominous resolution.”
Eliezer Yudkowsky
Read more
“Okay, so either (a) I just teleported somewhere else entirely (b) they can fold space like no one's business or (c) they are simply ignoring all the rules.”
Eliezer Yudkowsky
Read more
“I don't want to rule the universe. I just think it could be more sensibly organised.”
Eliezer Yudkowsky
Read more
“In what weird alternative universe would that girl NOT be Sorted into Ravenclaw? If Hermione Granger didn't go to Ravenclaw then there was no good reason for Ravenclaw House to exist.”
Eliezer Yudkowsky
Read more
“I'm lazy! I hate work! Hate hard work in all its forms! Clever shortcuts, that's all I'm about!”
Eliezer Yudkowsky
Read more
“He really really really shouldn't have done that. Amazing how much more obvious that became one second after it was too late.”
Eliezer Yudkowsky
Read more
“You couldn't changed history. But you could get it right to start with. Do something differently the FIRST time around.This whole business with seeking Slytherin's secrets... seemed an awful lot like the sort of thing where, years later, you would look back and say, 'And THAT was where it all started to go wrong.'And he would wish desperately for the ability to fall back through time and make a different choice. Wish granted. Now what?”
Eliezer Yudkowsky
Read more
“To worship a sacred mystery was just to worship your own ignorance.”
Eliezer Yudkowsky
Read more
“Every mystery ever solved had been a puzzle from the dawn of the human species right up until someone solved it.”
Eliezer Yudkowsky
Read more
“He wanted to write someone and demand a refund on his dark side which clearly ought to have irresistible magical power but had turned out to be defective.”
Eliezer Yudkowsky
Read more
“It is time," said the Lord Pilot, "to see this calamity to its end." Spoken in Archaic English: the words uttered by Thomas Clarkson in 1785, at the beginning of the end of slavery. "I have set my will against this disaster; I will break it, or it will break me." Ira Howard in 2014. "I will not share my universe with this shadow," and that was the Lord Pilot, in an anger hotter than the nova's ashes. "Help me if you will, or step aside if you lack decisiveness; but do not make yourself my obstacle, or I will burn you down, and any that stand with you -”
Eliezer Yudkowsky
Read more
“World domination is such an ugly phrase. I prefer to call it world optimisation.”
Eliezer Yudkowsky
Read more
“There is no justice in the laws of nature, no term for fairness in the equations of motion. The Universe is neither evil, nor good, it simply does not care. The stars don't care, or the Sun, or the sky. But they don't have to! WE care! There IS light in the world, and it is US!”
Eliezer Yudkowsky
Read more
“In a moral dilemma where you lost something either way, making the choice would feel bad either way, so you could temporarily save yourself a little mental pain by refusing to decide. At the cost of not being able to plan anything in advance, and at the cost of incurring a huge bias toward inaction or waiting until too late...”
Eliezer Yudkowsky
Read more
“Doing worse with more knowledge means you are doing something very wrong.”
Eliezer Yudkowsky
Read more
“A true rationalist ought to be effective in the real world.”
Eliezer Yudkowsky
Read more
“To confess your fallibility and then do nothing about it is not humble; it is boasting of your modesty.”
Eliezer Yudkowsky
Read more
“Sometimes Harry thought the deepest split in his personality wasn't anything to do with his dark side; rather it was the divide between the altruistic and forgiving Abstract Reasoning Harry, versus the frustrated and angry Harry In The Moment.”
Eliezer Yudkowsky
Read more
“No..." said Professor Quirrell. "That is not why I am here. You have made no effort to hide your dislike for me, Miss Granger. I thank you for that lack of pretense, for I much prefer true hate to false love.”
Eliezer Yudkowsky
Read more
“Your strength as a rationalist is your ability to be more confused by fiction than by reality. If you are equally good at explaining any outcome, you have zero knowledge.”
Eliezer Yudkowsky
Read more
“Most Muggles lived in a world defined by the limits of what you could do with cars and telephones. Even though Muggle physics explicitly permitted possibilities like molecular nanotechnology or the Penrose process for extracting energy from black holes, most people filed that away in the same section of their brain that stored fairy tales and history books, well away from their personal realities: Long ago and far away, ever so long ago.”
Eliezer Yudkowsky
Read more
“The glass display cases had shown rock-throwers crafted by the Australian aborigines - like giant wooden shoehorns, they'd looked, but smoothed and carved and ornamented with the most painstaking care. In the 40,000 years since anatomically modern humans had migrated to Australia from Asia, nobody had invented the bow-and-arrow. It really made you appreciate how non-obvious was the idea of Progress. Why would you even think of Invention as something important, if all your history's heroic tales were of great warriors and defenders instead of Thomas Edison? How could anyone possibly have suspected, while carving a rock-thrower with painstaking care, that someday human beings would invent rocket ships and nuclear energy?”
Eliezer Yudkowsky
Read more
“[...] intelligent people only have a certain amount of time (measured in subjective time spent thinking about religion) to become atheists. After a certain point, if you're smart, have spent time thinking about and defending your religion, and still haven't escaped the grip of Dark Side Epistemology, the inside of your mind ends up as an Escher painting.”
Eliezer Yudkowsky
Read more
“Without thinking about it at all, Harry stepped in front of Hermione.There was an intake of breath from behind him, and then a moment later Hermione brushed past and stepped in front of him. "Run, Harry!" she said. "Boys shouldn't have to be in danger.”
Eliezer Yudkowsky
Read more
“And then Harry Potter had launched in to a speech that was inspiring, yet vague. A speech to the effect that Fred and George and Lee had tremendous potential if they could just learn to be weirder. To make people's live surreal, instead of just surprising them with the equivalents of buckets of water propped above doors. (Fred and George had exchanged interested looks, they'd never thought of that one.) Harry Potter had invoked a picture of the prank they'd pulled on Neville - which, Harry had mentioned with some remorse, the Sorting Hat had chewed him out on - but which must have made Neville doubt his own sanity. For Neville it would have felt like being suddendly transported into an alternate universe. The same way everyone else had felt when they'd seen Snape apologize. That was the true power of pranking.”
Eliezer Yudkowsky
Read more
“But it is cute. It's such a boy thing to do.Drop dead.Aw, you say the most romantic things.”
Eliezer Yudkowsky
Read more
“One of chief pieces of advice I give to aspiring rationalists is "Don't try to be clever." And, "Listen to those quiet, nagging doubts." If you don't know, you don't know what you don't know, you don't know how much you don't know, and you don't know how much you needed to know.”
Eliezer Yudkowsky
Read more
“And someday when the descendants of humanity have spread from star to star they won’t tell the children about the history of Ancient Earth until they’re old enough to bear it and when they learn they’ll weep to hear that such a thing as Death had ever once existed”
Eliezer Yudkowsky
Read more
“Boys," said Hermione Granger, "should not be allowed to love girls without asking them first! This is true in a number of ways and especially when it comes to gluing people to the ceiling!”
Eliezer Yudkowsky
Read more
“Why does any kind of cynicism appeal to people? Because it seems like a mark of maturity, of sophistication, like you’ve seen everything and know better. Or because putting something down feels like pushing yourself up.”
Eliezer Yudkowsky
Read more
“When you are older, you will learn that the first and foremost thing which any ordinary person does is nothing.”
Eliezer Yudkowsky
Read more