Rationality Quotes May 2012

Here's the new thread for posting quotes, with the usual rules:

  • Please post all quotes separately, so that they can be voted up/down separately.  (If they are strongly related, reply to your own comments.  If strongly ordered, then go ahead and post them together.)
  • Do not quote yourself
  • Do not quote comments/posts on LW/OB
  • No more than 5 quotes per person per monthly thread, please.

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 9:00 PM
Select new highlight date
All comments loaded

Tags like "stupid," "bad at __", "sloppy," and so on, are ways of saying "You're performing badly and I don't know why." Once you move it to "you're performing badly because you have the wrong fingerings," or "you're performing badly because you don't understand what a limit is," it's no longer a vague personal failing but a causal necessity. Anyone who never understood limits will flunk calculus. It's not you, it's the bug.

-celandine13 (Hat-tip to Frank Adamek. In addition, the linked article is so good that I had trouble picking something to put in rationality quotes; in other words, I recommend it.)

Another quote from the same piece, just before that para:

Once you start to think of mistakes as deterministic rather than random, as caused by "bugs" (incorrect understanding or incorrect procedures) rather than random inaccuracy, a curious thing happens.

You stop thinking of people as "stupid."

I really, really like this. Thanks for posting it!

To elucidate the "bug model" a bit, consider "bugs" not in a single piece of software, but in a system. The following is drawn from my professional experience as a sysadmin for large-scale web applications, but I've tried to make it clear:

Suppose that you have a web server; or better yet, a cluster of servers. It's providing some application to users — maybe a wiki, a forum, or a game. Most of the time when a query comes in from a user's browser, the server gives a good response. However, sometimes it gives a bad response — maybe it's unusually slow, or it times out, or it gives an error or an incomplete page instead of what the user was looking for.

It turns out that if you want to fix these sorts of problems, considering them merely to be "flakiness" and stopping there is not enough. You have to actually find out where the errors are coming from. "Flaky web server" is an aggregate property, not a simple one; specifically, it is the sum of all the different sources of error, slowness, and other badness — the disk contention; the database queries against un-indexed tables; the slowly failing NIC; the excess load from the web spider that's copying the main page ten times a second looking for updates; the design choice of retrying failed transactions repeatedly, thus causing overload to make itself worse.

There is some fact of the matter about which error sources are causing more failures than others, too. If 1% of failed queries are caused by a failing NIC, but 90% are caused by transactions timing out due to slow database queries to an overloaded MySQL instance, then swapping the NIC out is not going to help much. And two flaky websites may be flaky for completely unrelated reasons.

Talking about how flaky or reliable a web server is lets you compare two web servers side-by-side and decide which one is preferable. But by itself it doesn't let you fix anything. You can't just point at the better web server and tell the worse one, "Why can't you be more like your sister?" — or rather, you can, but it doesn't work. The differences between the two do matter, but you have to know which differences matter in order to actually change things.

To bring the analogy back to human cognitive behavior: yes, you can probably measure which of two people is "more rational" than the other, or even "more intelligent". But if someone wants to become more rational, they can't do it by just trying to imitate an exemplary rational person — they have to actually diagnose what kinds of not-rational they are being, and find ways to correct them. There is no royal road to rationality; you have to actually struggle with (or work around) the specific bugs you have.

Once upon a time, there was a man who was riding in a horse drawn carriage and traveling to go take care of some affairs; and in the carriage there was also a very big suitcase. He told the driver to of the carriage to drive non-stop and the horse ran extremely fast.
Along the road, there was an old man who saw them and asked, “Sir, you seem anxious, where do you need to go?”
The man in the carriage then replied in a loud voice, “I need to go to the state of Chu.” The old man heard and laughing he smiled and said, “You are going the wrong way. The state of Chu is in the south, how come you are going to to the north?”
“That’s alright,” The man in the carriage then said, “Can you not see? My horse runs very fast.”
“Your horse is great, but your path is incorrect.”
“It’s no problem, my carriage is new, it was made just last month.”
“Your carriage is brand new, but this is not the road one takes to get to Chu.”
“Old Uncle, you don’t know,” and the man in the carriage pointed to the suitcase in the back and said, “In that suitcase there’s alot of money. No matter how long the road is, I am not afraid.”
“You have lots of money, but do not forget, The direction which you are going is wrong. I can see, you should go back the direction which you came from.”
The man in the carriage heard this and irritated said, “I have already been traveling for ten days, how can you tell me to go back from where I came?” He then pointed at the carriage driver and said, “Take a look, he is very young, and he drives very well, you needn’t worry. Goodbye!”
And then he told the driver to drive forward, and the horse ran even faster.

--Chinese Tale

For example, in many ways nonsense is a more effective organizing tool than the truth. Anyone can believe in the truth. To believe in nonsense is an unforgeable demonstration of loyalty. It serves as a political uniform. And if you have a uniform, you have an army.

--Mencius Moldbug, on belief as attire and conspicuous wrongness.

Source.

Being - forgive me - rather cleverer than most men, my mistakes tend to be correspondingly huger.

Albus Dumbledore

If there is something really cool and you can't understand why somebody hasn't done it before, it's because you haven't done it yourself.

-- Lion Kimbro, "The Anarchist's Principle"

If one does not know to which port one is sailing, no wind is favorable.

-Seneca

How a game theorist buys a car (on the phone with the dealer):

"Hello, my name is Bruce Bueno de Mesquita. I plan to buy the following car [list the exact model and features] today at five P.M. I am calling all of the dealerships within a fifty-mile radius of my home and I am telling each of them what I am telling you. I will come in and buy the car today at five P.M. from the dealer who gives me the lowest price. I need to have the all-in price, including taxes, dealer prep [I ask them not to prep the car and not charge me for it, since dealer prep is little more than giving you a washed car with plastic covers and paper floormats removed, usually for hundreds of dollars], everything, because I will make out the check to your dealership before I come and will not have another check with me."

From The Predictioneer's Game, page 7.

Other car-buying tips from Bueno de Mesquita, in case you're about to buy a car:

  • Figure out exactly what car you want to buy by searching online before making any contact with dealerships.
  • Don't be afraid to purchase a car from a distant dealership--the manufacturer provides the warranty, not the dealer.
  • Be sure to tell each dealer you will be sharing the price they quote you with subsequent dealers.
  • Don't take shit from dealers who tell you "you can't buy a car over the phone" or do anything other than give you their number. If a dealer is stonewalling, make it quite clear that you're willing to get what you want elsewhere.
  • Arrive at the lowest-price dealer just before 5:00 PM to close the deal. In the unlikely event that the dealer changes their terms, go for the next best price.

From my limited experience with buying cars, as well as from theoretical considerations, this won't work because you lack the pre-commitment to buy at the price offered. Once they give you a favorable price, you can try to push it even further downwards, possibly by continuing to play the dealerships against each other. So they'll be afraid to offer anything really favorable. (The market for new cars is a confusopoly based on concealing the information about the dealers' exact profit margins for particular car models, which is surprisingly well-guarded insider knowledge. So once you know that a certain price is still profitable for them, it can only be a downward ratchet.)

The problem can be solved by making the process double-blind, i.e. by sending the message anonymously through a credible middleman, who communicates back anonymous offers from all dealers. (The identities of each party are revealed to the other only if the offer is accepted and an advance paid.) Interestingly, in Canada, someone has actually tried to commercialize this idea and opened a website that offers the service for $50 or so (unhaggle.com); I don't know if something similar exists in the U.S. or other countries. (They don't do any sort of bargaining, brokering, deal-hunting, etc. on your behalf -- just the service of double-anonymous communication, along with signaling that your interest is serious because you've paid their fee.) From my limited observations, it works pretty well.

The Disobedi-Ant

The story of the Disobedi-Ant is very short. It refused to believe that its powerful impulses to play instead of work were anything but unique expressions of its very unique self, and it went its merry way, singing, "What I choose to do has nothing to do with what any-ant else chooses to do! What could be more self-evident?"

Coincidentally enough, so went the reasoning of all its colony-mates. In fact, the same refrain was independently invented by every last ant in the colony, and each ant thought it original. It echoed throughout the colony, even with the same melody.

The colony perished.

-Douglas Hofstadter (posted with gwern's "permission")

Let me never fall into the vulgar mistake of dreaming that I am persecuted whenever I am contradicted.

-Ralph Waldo Emerson, probably not apocryphal (at first, this comment said "possibly apocryphal since I can't find it anywhere except collections of quotes")

Inspired by maia's post:

“When life gives you lemons, don’t make lemonade. Make life take the lemons back! Get mad! I don’t want your damn lemons, what the hell am I supposed to do with these? Demand to see life’s manager! Make life rue the day it thought it could give Cave Johnson lemons! Do you know who I am? I’m the man who’s gonna burn your house down! With the lemons! I’m gonna get my engineers to invent a combustible lemon that burns your house down!”

---Cave Johnson, Portal 2

"When life hands you lemons, make lemonade" = "I have water and sugar and you don't, aren't I awesome"

Steven Kaas

Asked today if the Titanic II could sink, Mr Palmer told reporters: "Of course it will sink if you put a hole in it."

http://www.smh.com.au/business/clive-palmer-plans-to-build-titanic-ii-20120430-1xtrc.html

"It is indeed true that he [Hume] claims that 'reason is, and ought only to be the slave of the passions.' But a slave, it should not be forgotten, does virtually all the work."

-Alan Carter, Pluralism and Projectivism

Saying "what kind of an idiot doesn't know about the Yellowstone supervolcano" is so much more boring than telling someone about the Yellowstone supervolcano for the first time.

xkcd

[Political "gaffe" stories] are completely information-free news events, and they absolutely dominate political news coverage and analysis. It's like asking your doctor if the X-rays show a tumor, and all he'll talk about is how stupid the radiologist's haircut looks. . . . ["Blast"] stories are. . . just as content-free as the "gaffe" stories. But they are popular for the same reason: There's a petty, tribal satisfaction in seeing a member of our team really put the other team in their place. And there's a rush of outrage adrenaline when the other team says something mean about us. So, instead of covering pending legislation or the impact it could have on your life, the news media covers the dick-measuring contest.

-David Wong, 5 Ways to Spot a B.S. Political Story in Under 10 Seconds

If you want to build a ship, don't drum up the men to gather wood, divide the work and give orders. Instead, teach them to yearn for the vast and endless sea...

  • Antoine de Saint Exupery

The larger the island of knowledge, the longer the shoreline of wonder.

Wikiquotes: Huston Smith Wikipedia: Ralph Washinton Sockman

Only while the island is smaller than half the world :-)

Anyway, I can always measure your shore and get any result I want.

The Patrician steepled his hands and looked at Vimes over the top of them.

"Let me give you some advice, Captain," he said.

"Yes, sir?"

"It may help you make some sense of the world."

"Sir."

"I believe you find life such a problem because you think there are the good people and the bad people," said the man. "You're wrong, of course. There are, always and only, the bad people, but some of them are on opposite sides. "

He waved his thin hand towards the city and walked over to the window.

"A great rolling sea of evil," he said, almost proprietorially. "Shallower in some places, of course, but deeper, oh, so much deeper in others. But people like you put together little rafts of rules and vaguely good intentions and say, this is the opposite, this will triumph in the end. Amazing!" He slapped Vimes good-naturedly on the back.

"Down there," he said, "are people who will follow any dragon, worship any god, ignore any iniquity. All out of a kind of humdrum, everyday badness. Not the really high, creative loathesomeness of the great sinners, but a sort of mass-produced darkness of the soul. Sin, you might say, without a trace of originality. They accept evil not because they say yes, but because they don't say no. I'm sorry if this offends you,'' he added, patting the captain's shoulder, "but you fellows really need us."

"Yes, sir?" said Vimes quietly.

"Oh, yes. We're the only ones who know how to make things work. You see, the only thing the good people are good at is overthrowing the bad people. And you're good at that, I'll grant you. But the trouble is that it's the only thing you're good at. One day it's the ringing of the bells and the casting down of the evil tyrant, and the next it's everyone sitting around complaining that ever since the tyrant was overthrown no-one's been taking out the trash. Because the bad people know how to plan. It's part of the specification, you might say. Every evil tyrant has a plan to rule the world. The good people don't seem to have the knack."

"Maybe. But you're wrong about the rest!" said Vimes. "It's just because people are afraid, and alone-" He paused. It sounded pretty hollow, even to him.

He shrugged. "They're just people," he said. "They're just doing what people do. Sir."

Lord Vetinari gave him a friendly smile. "Of course, of course," he said. "You have to believe that, I appreciate. Otherwise you'd go quite mad. Otherwise you'd think you're standing on a feather-thin bridge over the vaults of Hell. Otherwise existence would be a dark agony and the only hope would be that there is no life after death. I quite understand."

(...)

After a while he made a few pencil annotations to the paper in front of him and looked up.

"I said," he said, "that you may go."

Vimes paused at the door.

"Do you believe all that, sir?" he said. "About the endless evil and the sheer blackness?"

"Indeed, indeed," said the Patrician, turning over the page. "It is the only logical conclusion."

"But you get out of bed every morning, sir?"

"Hmm? Yes? What is your point?"

"I'd just like to know why, sir."

"Oh, do go away, Vimes. There's a good fellow."

-- Terry Pratchett, "Guards! Guards!"

I really like the character of Lord Vetinari. He's like a more successful version of Quirrell from HPMOR who decided that it's okay to have cynical beliefs but idealistic aims.

If the difficulty of a physiological problem is mathematical in essence, ten physiologists ignorant of mathematics will get precisely as far as one physiologist ignorant of mathematics and no further.

Norbert Wiener

"If God gives you lemons, you find a new God."

-- Powerthirst 2: Re-Domination

I don't think we can get much more specific without starting to be mistaken.

Paul Graham, "Is It Worth Being Wise?" http://paulgraham.com/wisdom.html

“Smart people learn from their mistakes. But the real sharp ones learn from the mistakes of others.”

― Brandon Mull, Fablehaven

My function is to raise the possibility, 'Hey, you know, some of this stuff might be bullshit.'

-- Robert Anton Wilson

Contrarians of LW, if you want to be successful, please don't follow this strategy. Chances are that many people have raised the same possibility before, and anyway raising possibilities isn't Bayesian evidence, so you'll just get ignored. Instead, try to prove that the stuff is bullshit. This way, if you're right, others will learn something, and if you're wrong, you will have learned something.

For what it's worth, some context:

JW: To what extent do you think you've become a part of the New Age movement? The stalls in the atrium tonight seemed to be concerned with a lot of New Age material, and to an extent the way you've been talking about Virtual Realities and mind expansion you seem to be almost a forerunner of the movement.

RAW: The Berkeley mob once called Leary and me "the counter-culture of the counter-culture." I'm some kind of antibody in the New Age movement. My function is to raise the possibility, "Hey, you know, some of this stuff might be bullshit."

http://media.hyperreal.org/zines/est/intervs/raw.html

Wilson had a tendency to come across as a skeptic among mystics and a mystic among skeptics.

The word problem may be an insidious form of question-begging. To speak of the Jewish problem is to postulate that the Jews are a problem; it is to predict (and recommend) persecution, plunder, shooting, beheading, rape, and the reading of Dr. Rosenberg's prose. Another disadvantage of fallacious problems is that they bring about solutions that are equally fallacious. Pliny (Book VIII of Natural History) is not satisfied with the observation that dragons attack elephants in the summer; he ventures the hypothesis that they do it in order to drink the elephants' blood, which, as everyone knows, is very cold.

-- Jorge Luis Borges, "Dr. Américo Castro is Alarmed"

If you're trying to choose between two theories and one gives you an excuse for being lazy, the other one is probably right.

Paul Graham “What You’ll Wish You’d Known” http://paulgraham.com/hs.html

Is it fair to say you're enjoying the controversy you've started?
Thiel: I don't enjoy being contrarian.
Yes you do. *laughs*
Thiel: No, I think it is much more important to be right than to be contrarian.

--Peter Thiel, on 60 Minutes

[S]top whining and start hacking.

-- Paul Graham

(Arguably a decent philosophy of life, if a bit harshly expressed for my taste.)

Hey, I can hack and whine at the same time!

The universe, I'd learned, was never, ever kidding.

Cheryl Strayed, Wild

When scientists discuss papers:
"I don't think this inference is entirely reasonable. If you're using several non-independent variables you're liable to accumulate more error than your model accounts for."
When scientists discuss grants:
"A guy who worked at the NSF once told me if we light a candle inside this jackal skull, the funders will smile upon our hopes."
"I'll get the altar!"

~ Zach Weiner, SMBC #2559

“No matter how busy you may think you are, you must find time for reading, or surrender yourself to self-chosen ignorance.”

  • Confucius

"Well it's alright for you, Confucius, living in 5th Century feudal China. Between all the documentation I have to go through at work, and all the blogs I'm following while pretending to work, and all the textbooks I have to get through before my next assignment deadline, I don't have time to read!"

The atmosphere of political parties, whether in France or England, is not congenial to the formation of an impartial judgment. A Minister, who is in the thick of a tough parliamentary struggle, must use whatever arguments he can to defend his cause without inquiring too closely whether they are good, bad, or indifferent. However good they may be, they will probably not convince his political opponents, and they can scarcely be so bad as not to carry some sort of conviction to the minds of those who are predisposed to support him.

Evelyn Baring, Earl of Cromer, Modern Egypt

Plato says that the unexamined life is not worth living. But what if the examined life turns out to be a clunker as well?

-Kurt Vonnegut

if you can’t explain how to simulate your theory on a computer, chances are excellent that the reason is that your theory makes no sense!

-- Scott Aaronson