Rationality Quotes September 2011

Here's the new thread for posting quotes, with the usual rules:

  • Please post all quotes separately, so that they can be voted up/down separately.  (If they are strongly related, reply to your own comments.  If strongly ordered, then go ahead and post them together.)
  • Do not quote yourself.
  • Do not quote comments/posts on LW/OB.
  • No more than 5 quotes per person per monthly thread, please.

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 9:11 AM
Select new highlight date
Rendering 50/492 comments  show more

It is a vast, and pervasive, cognitive mistake to assume that people who agree with you (or disagree) do so on the same criteria that you care about.

Megan McArdle

Again and again, I’ve undergone the humbling experience of first lamenting how badly something sucks, then only much later having the crucial insight that its not sucking wouldn’t have been a Nash equilibrium.

--Scott Aaronson

If people can't think clearly about anything that has become part of their identity, then all other things being equal, the best plan is to let as few things into your identity as possible.

-- Paul Graham

One day, I was playing with an "express wagon," a little wagon with a railing around it, I noticed something about the way the ball moved. I went to my father and said, "Say, Pop, I noticed something. When I pull the wagon, the ball rolls to the back of the wagon. And when I'm pulling it along and I suddenly stop, the ball rolls to the front of the wagon. Why is that?"

"That, nobody knows," he said. "The general principle is that things which are moving tend to keep on moving, and things which are standing still tend to stand still, unless you push them hard. This tendency is called 'inertia,' but nobody knows why it's true." Now, that's a deep understanding. He didn't just give me the name.

-Richard Feynman

She generally gave herself very good advice, (though she very seldom followed it)

-- Lewis Carrol, "Alice's Adventures in Wonderland"

Hard to believe that it hasn't show up here before...

The church is near, but the road is icy. The bar is far away, but I will walk carefully.

-- Russian proverb

"The ordinary modes of human thinking are magical, religious, and social. We want our wishes to come true; we want the universe to care about us; we want the esteem of our peers. For most people, wanting to know the truth about the world is way, way down the list. Scientific objectivity is a freakish, unnatural, and unpopular mode of thought, restricted to small cliques whom the generality of citizens regard with dislike and mistrust."

— John Derbyshire

The typical citizen drops down to a lower level of mental performance as soon as he enters the political field. He argues and analyzes in a way which he would readily recognize as infantile within the sphere of his real interests. He becomes primitive again.

-Joseph A. Schumpeter, Capitalism, Socialism, and Democracy

In other words, politics is the mind killer.

It's one thing to make lemonade out of lemons, another to proclaim that lemons are what you'd hope for in the first place.

Gary Marcus, Kluge

Relevant to deathism and many other things

The proposition here is that the human brain is, in large part, a machine for winning arguments, a machine for convincing others that its owner is in the right - and thus a machine for convincing its owner of the same thing. The brain is like a good lawyer: given any set of interests to defend, it sets about convincing the world of their moral and logical worth, regardless of whether they in fact have any of either. Like a lawyer, the human brain wants victory, not truth; and, like a lawyer, it is sometimes more admirable for skill than for virtue.

Robert Wright, The Moral Animal

If you want to live in a nicer world, you need good, unbiased science to tell you about the actual wellsprings of human behavior. You do not need a viewpoint that sounds comforting but is wrong, because that could lead you to create ineffective interventions. The question is not what sounds good to us but what actually causes humans to do the things they do.

Douglas Kenrick

No matter how far you've gone down the wrong road, turn back.

-- Turkish proverb

“When you’re young, you look at television and think, There’s a conspiracy. The networks have conspired to dumb us down. But when you get a little older, you realize that’s not true. The networks are in business to give people exactly what they want. That’s a far more depressing thought. Conspiracy is optimistic! You can shoot the bastards! We can have a revolution! But the networks are really in business to give people what they want. It’s the truth.”

-Steve Jobs, [Wired, February 1996]

The rule that human beings seem to follow is to engage the brain only when all else fails - and usually not even then.

David Hull, Science and Selection: Essays on Biological Evolution and the Philosophy of Science

If we don't change our direction, we're likely to end up where we're headed.

-- Chinese proverb

Ian Stewart invented the game of tautoverbs. Take a proverb and manipulate it so that it's tautological. i.e. "Look after the pennies and the pennies will be looked after" or "No news is no news". There's a kind of Zen joy in forming them.

This proverb however, is already there.

Ralph Hull made a reasonable living as a magician milking a card trick he called "The Tuned Deck"...Hull enjoyed subjecting himself to the scrutiny of colleagues who attempted to eliminate, one by one, various explanations by depriving him of the ability to perform a particular sleight of hand. But the real trick was over before it had even begun, for the magic was not in clever fingers but in a clever name. The blatantly singular referent cried out for a blatantly singular explanation, when in reality The Tuned Deck was not one trick but many. The search for a single explanation is what kept this multiply determined illusion so long a mystery.

--Nicholas Epley, "Blackwell Handbook of Judgment and Decision Making"

"Asking a question is embarrassing for a moment, but not asking is embarrassing for a lifetime. "

--Haruki Murakami, Kafka on the Shore, 2006, p. 255

On practical questions of urgent importance we must make up our minds one way or the other even when we know that the evidence is incomplete. To refuse to make up our minds is equivalent to deciding to leave things as they are (which is just as likely as any other to be the wrong solution).

-- Robert H. Thouless

Imagine that everyone in North America took [a cognitive enhancement pill] before retiring and then woke up the next morning with more memory capacity and processing speed... I believe that there is little likelihood that much would change the next day in terms of human happiness. It is very unlikely that people would be better able to fulfill their wishes and desires the day after taking the pill. In fact, it is quite likely that people would simply go about their usual business - only more efficiently. If given more memory capacity and processing speed, people would, I believe: carry on using the same ineffective medical treatments because of failure to think of alternative causes; keep making the same poor financial decisions because of overconfidence; keep misjudging environmental risks because of vividness; play host to the [tempting bad ideas] of Ponzi and pyramid schemes; [and] be wrongly influenced in their jury decisions by incorrect testimony about probabilities... The only difference would be that they would be able to do all of these things much more quickly!

Keith Stanovich, What Intelligence Tests Miss

Better memory and processing power would mean that probabilistically more businessmen would realize there are good business opportunities where they saw none before. Creating more jobs and a more efficient economy, not the same economy more quickly.

ER doctors can now spend more processing power on each patient that comes in. Out of their existing repertoire they would choose better treatments for the problem at hand then they would have otherwise. A better memory means that they would be more likely to remember every step on their checklist when prepping for surgery.

It is not uncommon for people to make stupid decisions with mild to dire consequences because they are pressed for time. Everyone now thinks faster and has more time to think. Few people are pressed for time. Fewer accidents happen. Better decisions are made on average.

There are problems which are not human vs human but are human vs reality. With increased memory and processing power humanity gains an advantage over reality.

By no means is increasing memory and processing power a sliver bullet but it seems considerably more then everything only moving "much more quickly!"

Edit: spelling

It's a nice list, but I think the core point strikes me as liable to be simply false. I forget who it was presenting this evidence - it might even have been James Miller, it was someone at the Winter Intelligence conference at FHI - but they looked at (1) the economic gains to countries with higher average IQ, (2) the average gains to individuals with higher IQ, and concluded that (3) people with high IQ create vast amounts of positive externality, much more than they capture as individuals, probably mostly in the form of countries with less stupid economic policies.

Maybe if we're literally talking about a pure speed and LTM pill that doesn't affect at all, say, capacity to keep things in short-term memory or the ability to maintain complex abstractions in working memory, i.e., a literal speed and disk space pill rather than an IQ pill.

But naturally doing everything faster would be pretty freaking awesome in itself.

  • increased yearly economic growth (consequently higher average living standards since babies still take 9 months to make)
  • it would help everyone cram much more living into their lifespan.
  • it would help experts deal with events that aren't sped up much better. Say an oil leak in the Gulf of Mexico.
  • medical advances would arrive earlier meaning that lots of people who would otherwise have died might live for a few more productive (sped up!) years.

But I'm having way to much fun nitpicking so I'll just stop here. :)

I think it would take more than a day for people to get possible good effects of the change.

A better memory might enable people to realize that they have made the same mistake several times. More processing power might enable them to realize that they have better strategies in some parts of their lives than others, and explore bringing the better strategies into more areas.

It is remarkable that [probability theory], which originated in the consideration of games of chance, should have become the most important object of human knowledge... The most important questions of life are, for the most part, really only problems of probability.

Laplace

The investor who finds a way to make soap from peanuts has more genuine imagination than the revolutionary with a bayonet, because he has cultivated the faculty of imagining the hidden potentiality of the real. This is much harder than imagining the unreal, which may be why there are so many more utopians than inventors

  • Joe Sobran

From the day we arrive on the planet

and blinking, step into the sun

there's more to see than can ever be seen

more to do than can ever be done

--The Lion King opening song

I moved out of the hood for good, you blame me?

Niggas aim mainly at niggas they can't be.

But niggas can't hit niggas they can't see.

I'm out of sight, now I'm out of they dang reach.

-- Dr. Dre, "The Watcher"

One of my favorite genres in the prestige press is the Self-Refuting Article. These are articles that contain all the facts necessary to undermine the premise of the piece, but reporters, editors, and readers all conspire together in an act of collective stupidity to Not Get the Joke

--Steve Sailer

The enlightened individual has learned to ask not "Is it so?" but rather "What is the probability that it is so?"

Sheldon Ross

Kant was proud of having discovered in man the faculty for synthetic judgements a priori. But "How are synthetic judgements a priori possible?" How did Kant answer? By saying "By virtue of a faculty" (though unfortunately not in five words). But is that an answer? Or rather merely a repetition of the question? How does opium induce sleep? "by virtue of a faculty, namely the virtus dormitiva", replies the doctor in Molière. Such replies belong in comedy. It is high time to replace the Kantian question by another question, "Why is belief in such judgements necessary?"

Nietzsche, Beyond Good and Evil

If you cannot calculate you cannot speculate on future pleasure and your life will not be that of a human, but that of an oyster or a jellyfish.

Plato, Philebus

I know of no society in human history that ever suffered because its people became too desirous of evidence in support of their core beliefs.

-Sam Harris

I think there's a few posts by Yudkowsky that I think deserve the highest praise one can give to a philosopher's writing: That, on rereading them, I have no idea what I found so mindblowing about them the first time. Everything they say seems patently obvious now!

-- Ari Rahikkala

Ars longa, vita brevis, occasio praeceps, experimentum periculosum, iudicium difficile.

-Hippocrates

[The] art is long,
life is short,
opportunity fleeting,
experiment dangerous,
judgment difficult. 

Considering the beast that some hope to kill by sharpening people's mind-sticks on LW, this sounds applicable wouldn't you agree?

[...] Often I find that the best way to come up with new results is to find someone who's saying something that seems clearly, manifestly wrong to me, and then try to think of counterarguments. Wrong people provide a fertile source of research ideas.

-- Scott Aaronson, Quantum Computing Since Democritus (http://www.scottaaronson.com/democritus/lec14.html)

The key is that it's adaptive. It's not that it succeeds despite the bad results of its good intentions. It succeeds because of the bad results of its good intentions.

--Mencius Moldbug