Followup toNormal Cryonics

Yesterday I spoke of that cryonics gathering I recently attended, where travel by young cryonicists was fully subsidized, leading to extremely different demographics from conventions of self-funded activists.  34% female, half of those in couples, many couples with kids - THAT HAD BEEN SIGNED UP FOR CRYONICS FROM BIRTH LIKE A GODDAMNED SANE CIVILIZATION WOULD REQUIRE - 25% computer industry, 25% scientists, 15% entertainment industry at a rough estimate, and in most ways seeming (for smart people) pretty damned normal.

Except for one thing.

During one conversation, I said something about there being no magic in our universe.

And an ordinary-seeming woman responded, "But there are still lots of things science doesn't understand, right?"

Sigh.  We all know how this conversation is going to go, right?

So I wearily replied with my usual, "If I'm ignorant about a phenomenon, that is a fact about my state of mind, not a fact about the phenomenon itself; a blank map does not correspond to a blank territory -"

"Oh," she interrupted excitedly, "so the concept of 'magic' isn't even consistent, then!"

Click.

She got it, just like that.

This was someone else's description of how she got involved in cryonics, as best I can remember it, and it was pretty much typical for the younger generation:

"When I was a very young girl, I was watching TV, and I saw something about cryonics, and it made sense to me - I didn't want to die - so I asked my mother about it.  She was very dismissive, but tried to explain what I'd seen; and we talked about some of the other things that can happen to you after you die, like burial or cremation, and it seemed to me like cryonics was better than that.  So my mother laughed and said that if I still felt that way when I was older, she wouldn't object.  Later, when I was older and signing up for cryonics, she objected."

Click.

It's... kinda frustrating, actually.

There are manifold bad objections to cryonics that can be raised and countered, but the core logic really is simple enough that there's nothing implausible about getting it when you're eight years old (eleven years old, in my case).

Freezing damage?  I could go on about modern cryoprotectants and how you can see under a microscope that the tissue is in great shape, and there are experiments underway to see if they can get spontaneous brain activity after vitrifying and devitrifying, and with molecular nanotechnology you could go through the whole vitrified brain atom by atom and do the same sort of information-theoretical tricks that people do to recover hard drive information after "erasure" by any means less extreme than a blowtorch...

But even an eight-year-old can visualize that freezing a sandwich doesn't destroy the sandwich, while cremation does.  It so happens that this naive answer remains true after learning the exact details and defeating objections (a few of which are even worth considering), but that doesn't make it any less obvious to an eight-year-old.  (I actually did understand the concept of molecular nanotech at eleven, but I could be a special case.)

Similarly: yes, really, life is better than death - just because transhumanists have huge arguments with bioconservatives over this issue, doesn't mean the eight-year-old isn't making the right judgment for the right reasons.

Or: even an eight-year-old who's read a couple of science-fiction stories and who's ever cracked a history book can guess - not for the full reasons in full detail, but still for good reasons - that if you wake up in the Future, it's probably going to be a nicer place to live than the Present.

In short - though it is the sort of thing you ought to review as a teenager and again as an adult - from a rationalist standpoint, there is nothing alarming about clicking on cryonics at age eight... any more than I should worry about my first schism with Orthodox Judaism coming at age five, when they told me that I didn't have to understand the prayers in order for them to work so long as I said them in Hebrew.  It really is obvious enough to see as a child, the right thought for the right reasons, no matter how much adult debate surrounds it.

And the frustrating thing was that - judging by this group - most cryonicists are people to whom it was just obvious.  (And who then actually followed through and signed up, which is probably a factor-of-ten or worse filter for Conscientiousness.)  It would have been convenient if I'd discovered some particular key insight that convinced people.  If people had said, "Oh, well, I used to think that cryonics couldn't be plausible if no one else was doing it, but then I read about Asch's conformity experiment and pluralistic ignorance."  Then I could just emphasize that argument, and people would sign up.

But the average experience I heard was more like, "Oh, I saw a movie that involved cryonics, and I went on Google to see if there was anything like that in real life, and found Alcor."

In one sense this shouldn't surprise a Bayesian, because the base rate of people who hear a brief mention of cryonics on the radio and have an opportunity to click, will be vastly higher than the base rate of people who are exposed to detailed arguments about cryonics...

Yet the upshot is that - judging from the generation of young cryonicists at that event I attended - cryonics is sustained primarily by the ability of a tiny, tiny fraction of the population to "get it" just from hearing a casual mention on the radio.  Whatever part of one-in-a-hundred-thousand isn't accounted for by the Conscientiousness filter.

If I suffered from the sin of underconfidence, I would feel a dull sense of obligation to doubt myself after reaching this conclusion, just like I would feel a dull sense of obligation to doubt that I could be more rational about theology than my parents and teachers at the age of five.  As it is, I have no problem with shrugging and saying "People are crazy, the world is mad."

But it really, really raises the question of what the hell is in that click.

There's this magical click that some people get and some people don't, and I don't understand what's in the click.  There's the consequentialist/utilitarian click, and the intelligence explosion click, and the life-is-good/death-is-bad click, and the cryonics click.  I myself failed to click on one notable occasion, but the topic was probably just as clickable.

(In fact, it took that particular embarrassing failure in my own history - failing to click on metaethics, and seeing in retrospect that the answer was clickable - before I was willing to trust non-click Singularitarians.)

A rationalist faced with an apparently obvious answer, must assign some probability that a non-obvious objection will appear and defeat it.  I do know how to explain the above conclusions at great length, and defeat objections, and I would not be nearly as confident (I hope!) if I had just clicked five seconds ago.  But sometimes the final answer is the same as the initial guess; if you know the full mathematical story of Peano Arithmetic, 2 + 2 still equals 4 and not 5 or 17 or the color green.  And some people very quickly arrive at that same final answer as their best initial guess; they can swiftly guess which answer will end up being the final answer, for what seem even in retrospect like good reasons.  Like becoming an atheist at eleven, then listening to a theist's best arguments later in life, and concluding that your initial guess was right for the right reasons.

We can define a "click" as following a very short chain of reasoning, which in the vast majority of other minds is derailed by some detour and proves strongly resistant to re-railing.

What makes it happen?  What goes into that click?

It's a question of life-or-death importance, and I don't know the answer.

That generation of cryonicists seemed so normal apart from that...

What's in that click?

The point of the opening anecdote about the Mind Projection Fallacy (blank map != blank territory) is to show (anecdotal) evidence that there's something like a general click-factor, that someone who clicked on cryonics was able to click on mysteriousness=projectivism as well.  Of course I didn't expect that I could just stand up amid the conference and describe the intelligence explosion and Friendly AI in a couple of sentences and have everyone get it.  That high of a general click factor is extremely rare in my experience, and the people who have it are not otherwise normal.  (Michael Vassar is one example of a "superclicker".)  But it is still true AFAICT that people who click on one problem are more likely than average to click on another.

My best guess is that clickiness has something to do with failure to compartmentalize - missing, or failing to use, the mental gear that lets human beings believe two contradictory things at the same time.  Clicky people would tend to be people who take all of their beliefs at face value.

The Hansonian explanation (not necessarily endorsed by Robin Hanson) would say something about clicky people tending to operate in Near mode.  (Why?)

The naively straightforward view would be that the ordinary-seeming people who came to the cryonics did not have any extra gear that magically enabled them to follow a short chain of obvious inferences, but rather, everyone else had at least one extra insanity gear active at the time they heard about cryonics.

Is that really just it?  Is there no special sanity to add, but only ordinary madness to take away?  Where do superclickers come from - are they just born lacking a whole lot of distractions?

What the hell is in that click?

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 4:38 AM
Select new highlight date
Rendering 50/413 comments  show more

My best guess is that clickiness has something to do with failure to compartmentalize - missing, or failing to use, the mental gear that lets human beings believe two contradictory things at the same time. Clicky people would tend to be people who take all of their beliefs at face value.

One of the things that I've noticed about this is that most people do not expect to understand things. For most people, the universe is a mysterious place filled with random events beyond their ability to comprehend or control. Think "guessing the teacher's password", but not just in school or knowledge, but about everything.

Such people have no problem with the idea of magic, because everything is magic to them, even science.

An anecdote: once, when I still worked as software developer/department manager in a corporation, my boss was congratulating me on a million dollar project (revenue, not cost) that my team had just turned in precisely on time with no crises.

Well, not congratulating me, exactly. He was saying, "wow, that turned out really well", and I felt oddly uncomfortable. After getting off the phone, I realized a day or so later that he was talking about it like it was luck, like, "wow, what nice weather we had."

So I called him back and had a little chat about it. The idea that the project had succeeded because I designed it that way had not occurred to him, and the idea that I had done it by the way I negotiated the requirements in the first place -- as opposed to heroic efforts during the project -- was quite an eye opener for him.

Fortunately, he (and his boss) were "clicky" enough in other areas (i.e., they didn't believe computers were magic, for example) that I was able to make the math of what I was doing click for them at that "teachable moment".

Unfortunately, most people, in most areas of their lives treat everything as magic. They're not used to being able to understand or control anything but the simplest of things, so it doesn't occur to them to even try. Instead, they just go along with whatever everybody else is thinking or doing.

For such (most) people, reality is social, rather than something you understand/ control.

(Side note: I find myself often trying to find a way to express grasp/control as a pair, because really the two are the same. If you really grasp something, you should be able to control it, at least in principle.)

Such people have no problem with the idea of magic, because everything is magic to them, even science.

Years ago I and three other people were training for a tech support job. Our trainer was explaining something (the tracert command) but I didn't understand it because his explanation didn't seem to make sense. After asking him more questions about it, I realized from his contradictory answers that he didn't understand it either. The reason I mention this is that my three fellow trainees had no problem with his explanation, one even explicitly saying that she thought it made perfect sense.

Huh. I guess that if I tell myself, "Most people simply do not expect reality to make sense, and are trying to do entirely different things when they engage in the social activity of talking about it", then I do feel a little less confused.

Most people simply do not expect reality to make sense

More precisely, different people are probably using different definitions of "make sense"... and you might find it easier to make sense of if you had a more detailed understanding of the ways in which people "make sense". (Certainly, it's what helped me become aware of the issue in the first place.)

So, here are some short snippets from the book "Using Your Brain For A Change", wherein the author comments on various cognitive strategies he's observed people using in order to decide whether they "understand" something:

There are several kinds of understanding, and some of them are a lot more useful than others. One kind of understanding allows you to justify things, and gives you reasons for not being able to do anything different....

A second kind of understanding simply allows you to have a good feeling: "Ahhhh." It's sort of like salivating to a bell: it's a conditioned response, and all you get is that good feeling. That's the kind of thing that can lead to saying, "Oh, yes, 'ego' is that one up there on the chart. I've seen that before; yes, I understand." That kind of understanding also doesn't teach you to be able to do anything.

A third kind of understanding allows you to talk about things with important sounding concepts, and sometimes even equations.... Concepts can be useful, but only if they have an experiential basis [i.e. "near" beliefs that "pay rent"], and only if they allow you to do something different.

Obviously, we are talking mostly about "clicking" being something more like this latter category of sense-making, but the author actually did mention how certain kinds of "fuzzy" understanding would actually be more helpful in social interaction:

However, a fuzzy, bright understanding will be good for some things. For example, this is probably someone who would be lots of fun at a party. She'll be a very responsive person, because all she needs to do to feel like she understands what someone says is to fuzz up her [mental] pictures. It doesn't take a lot of information to be able to make a bright, fuzzy movie. She can do that really quickly, and then have a lot of feelings watching that bright movie. Her kind of understanding is the kind I talked about earlier, that doesn't have much to do with the outside world. It helps her feel better, but it won't be much help in coping with actual problems.

Most of the chapter concerned itself with various cognitive strategies of detailed understanding used by a scientist, a pilot, an engineer, and so on, but it also pointed out:

What I want you all to realize is that all of you are in the same position as that ... woman who fuzzes images. No matter how good you think your process of understanding is, there will always be times and places where another process would work much better for you. Earlier someone gave us the process a scientist used -- economical little pictures with diagrams. That will work marvelously well for [understanding] the physical world, but I'll predict that person has difficulties understanding people -- a common problem for scientists. (Man: Yes, that's true.)

Anyway, that chapter was a big clue for me towards "clicking" on the idea that the first two obstacles to be overcome in communicating a new concept are 1) getting people to realize that there's something to "get", and 2) getting them to get that they don't already "get" it. (And both of these can be quite difficult, especially if the other person thinks they have a higher social status than you.)

I'm still confused, but now my eyes are wide with horror, too. I don't dispute what pjeby said; in retrospect it seems terribly obvious. But how can we deal with it? Is there any way to get someone to start expecting reality to make sense?

I have a TA job teaching people how to program, and I watch as people go from desperately trying to solve problems by blindly adapting example code that they don't understand to actually thinking and being able to translate their thoughts into working, understandable programs. I think the key of it is to be thrust into situations that require understanding instead of just guessing the teacher's password -- the search space is too big for brute force. The class is all hands-on, doing toy problems that keep people struggling near the edge of their ability. And it works, somehow! I'm always amazed when they actually, truly learn something. I think this habit of expecting to understand things can be taught in at least one field, albeit painfully.

Is this something that people can learn in general? How? I consider this a hugely important question.

During my military radio ops course, I realized that the woman teaching us about different frequencies literally thought that 'higher' frequencies were higher off the ground. Like you, I found her explanations deeply confusing, though I suspect most of the other candidates would have said it made sense. (Despite being false, this theory was good enough to enable radio operations - though presumably not engineering).

Thankfully I already had a decent founding in EM, otherwise I would have yet more cached garbage to clear - sometimes it's worse than finding the duplicate mp3s in my music library.

This is overwhelmingly how I perceive most people. This in particular: 'reality is social'.

I have personally traced the difference, in myself, to receiving this book at around the age of three or four. It has illustrations of gadgets and appliances, with cut-out views of their internals. I learned almost as soon as I was capable of learning, that nothing is a mysterious black box, things that seem magical have internal detail, and there are explanations for how they work. Whether or not I had anything like a pre-existing disposition that made me love and devour the book in the first place, I still consider it to have had a bigger impact on my whole world view than anything else I can remember.

So I called him back and had a little chat about it. The idea that the project had succeeded because I designed it that way had not occurred to him, and the idea that I had done it by the way I negotiated the requirements in the first place -- as opposed to heroic efforts during the project -- was quite an eye opener for him.

The Inside View says, 'we succeeded because of careful planning of X, Y, and Z, and our own awesomeness.' The Outside View says, 'most large software projects fail, but some succeed anyway.'

The Inside View says, 'we succeeded because of careful planning of X, Y, and Z, and our own awesomeness.' The Outside View says, 'most large software projects fail, but some succeed anyway.'

What makes you think it was the only one, or one of a few out of many?

The specific project was only relevant because my bosses prior to that point in time already implicitly understood that there was something my team was doing that got our projects done on time when others under their authority were struggling - but they attributed it to intelligence or skill on my part, rather than our methodology/philosophy.

The newer boss, OTOH, didn't have any direct familiarity with my track record, and so didn't attribute the success to me at all, except that obviously I hadn't screwed it up.

Once upon a time, I had a job where most of what I did involved signing up people for cryonics. I'm guessing that few other people on this site can say they've ever made a salary off that (unless you're reading this, Derek), and so I can speak with some small authority. Over those four excruciating years at Alcor, I spent hundreds of hours discussing the subject with hundreds of people.

Obviously I never came up with a definitive answer as to why some people get it and most don't. But I developed a working map of the conceptual space. Rather than a single "click," I found that there were a series of memetic filters.

The first and largest by far tended to be religious, which is to say, afterlife mythology. If you thought you were going to Heaven, Kolob, another plane of existence, or another body, you wouldn't bother investing the money or emotional effort in cryonics.

Only then came the intellectual barriers, but the boundary could be extremely vague. I think that the vast majority of people didnt have any trouble grasping the basic scientific arguments for cryonics; the actual logic filter always seemed relatively thin to me. Instead, people used their intellect to rationalize against cryonics, either motivated by existing beliefs (from one end) or by resulting anxieties (from the other).

Anxieties relating to cryonics tended to revolve around social situation and/or death. Some people identified so deeply with their current social situation, the idea of losing that situation (family, friends, standing, culture, etc.) was unthinkable. Others were afflicted by a sort of hypothetical survivor guilt; why did they deserve to live, when so many of their loved ones had died? Perhaps the majority were simply repulsed by any thought of death itself; most of them spent their lives trying not to think about the fact that we would die, and found it extremely depressing or disorienting when forced to confront that fact.

I don't think I could categorize the stages of approach to cryonics quite as neatly (and questionably) as the Kubler-Ross stages of dying. Clearly there was nothing inevitable about coming to accept cryonics, and approximately 90-95% of everyone I met never made it past the first filter. Even when people passed all of the memetic filters I've mentioned, they still had a tendency to become mired at the beginning or middle of their cryonics arrangements, floating in some sort of metastable emotional fog (starting cryonics arrangements felt like retreating from death, proceeding with them felt like approaching it).

Oh well, I haven't thought about this subject much since 1999. This is just my off-the-cuff memory of how I used to make a living.

Thank you for writing this.

If you ever feel like writing a longer post about your experience in the cryonics world, I'd love to read it and I suspect others would too.

Is that really just it? Is there no special sanity to add, but only ordinary madness to take away?

I think this is the primary factor. I've got a pretty amusing story about this.

Last week I met a relatively distant relative, a 15 year old guy who's in a sports oriented high school. He plays football, has not much scientific, literary or intellectual background, and is quite average and normal in most conceivable ways. Some TV program on Discovery was about "robots", and in a shortly unfolding 15 minute spontaneous conversation I've managed to explain him the core problems of FAI, without him getting stuck at any points of my arguments. I'm fairly sure that he had no previous knowledge about the subject.

First I made a remark in connection to the TV program's poetic question about what if robots will be able to get most human work done; I said that if robots get the low wage jobs, humans would eventually get paid more on average, and the problem is only there when robots can do everything humans can and somehow end up actually doing all those things.

Then he asked if I think they'll get that smart, and I answered that it's quite possible in this century. I explained recursive self-improvement in two sentences, to illustrate the reasons why they could potentially get very, very smart in a small amount of time. I talked about the technology that would probably allow AIs to act upon the world with great efficiency and power. Next, he said something like "that's good, wouldn't AI's would be a big help, like, they will invent new medicine?" At this point I was pretty amused. I assured him that AIs indeed have great potentials. I talked then very shortly about most basic AI topics, providing the usual illustrations like Hollywood AIs, smiley-tiled solar systems and foolish programmers overlooking the complexity of value. I delineated CEV in a simplified "redux" manner, focusing on the idea that we should optimally just extract all relevant information from human brains by scanning them, to make sure nothing we care about is left out. "That should be a huge technical problem, to scan that much brains", he said.

And now:

"But if the AI gets so potent, would not it be a problem anyway, even if it's perfectly friendly, that it can do everything much better than humans, and we'll get bored?"

"Hahh, not at all. If you think that getting all bored and unneeded is bad, then it is a real preference inside your head. It'll be taken into account by the AI, and it will make sure it'll not pamper you excessively."

"Ah, that sounds pretty reasonable".

Now, all of this happened in the course of roughly 15 minutes. No absurdity heuristic, no getting lost, no objections; he just took everything I said at face value, assuming that I'm more knowledgeable on these matters, and I was in general convinced that nothing I explained was particularly hard to grasp. He asked relevant questions and was very interested in what I said.

Some thoughts why this was possible:

  • The guy belongs to a certain social strata in Hungary, namely to those who newly entered the middle class by free entrepreneurship that became a possibility after the country switched to capitalism. At first, the socialist regime repressed religion and just about every human rights, then eased up, softened, and became what's known as the "happiest barrack". People became unconcerned with politics (which they could not influence) and religion (which was though of as a highly personal matter that should not be taken to public), they just focused on their own wealth and well-being. I'm convinced that the parents of the guy care zero about any religion, the absence of religion, doctrine, ideology or whatever. They just work to make a living and don't think about lofty matters, leaving their son ideologically perfectly intact. Just like my own parents.

  • Actually, AI is not intrinsically abstract or hard to digest; my interlocutor knew what an AI is, even if from movies, and probably watched just enough Discovery to have a sketchy picture about future technologies. The mind design space argument is not that hard (he had known about evolution because it's taught in school. He immediately agreed that AIs can be much smarter than humans because if we wait a million years, maybe humans can also become much smarter, so it's technically possible), and the smiley-tiled solar system is an entertaining and effective explanation about morality. I think that Eliezer has put extreme amounts of effort to maximize the chance that his AI ideas will get transmitted even to people who are primed or biased against AI or at risk of motivated skepticism. So far, I've had great success using his parables, analogues and ways of explanation.

  • My perceived status as an "intellectual" made him accept my explanations at face value. He's a football player in a smallish countryside city and I'm a serious college student in the capital city (it's good he doesn't know how lousy a student I am). Still, I do not think this was a significant factor. He probably does not talk about AI among football players, but being a male he has some basic interests in futuristic or gadgety subjects.

In the end, it probably all comes down to lacking some specific ways of craziness. Cryonics seemed normal on that convention Eliezer attended, and I'm sure every idea that is epistemically and morally correct can in principle be a so-called normal thing. Besides this guy, I've even had full success lecturing a 17 year old metal drummer on AI and SIAI - and he was situated socioeconomically very similarly to the first guy, and neither he had any previous knowledge.

There's this magical click that some people get and some people don't, and I don't understand what's in the click. There's the consequentialist/utilitarian click, and the intelligence explosion click, and the life-is-good/death-is-bad click, and the cryonics click.

I think it's a mistake to put all the opinions you agree with in a special category. Why do some people come quickly to beliefs you agree with? There is no reason, except that sometimes people come quickly to beliefs, and some beliefs happen to match yours.

People who share one belief with you are more likely to share others, so you're anecdotally finding people who agree with you about non-cryonics things at a cryonics conference. Young people might be more likely to change their mind quickly because they're more likely to hear something for the first time.

More strongly, is there any reason to believe that people are more likely to "click" to rational beliefs than irrational ones?

As an example, papal infallibility once clicked for me (during childhood religious education), which I think most people here would agree is wrong, even conditioned on the existence of God.

Mmm... I am a click-hunter. I keep pestering a topic and returning over and over until I feel it click. I can understand something well enough to start accurately predicting results but still refuse to be satisfied until I feel it click. Once it clicks I move on.

You and I may be describing different types of clicks, however. Here is a short list of things I have observed about the clicks in my life.

  • The minor step from not having a subject click and having a subject click is enormous. It is the single greatest leap in knowledge I will likely experience in a subject matter. I may learn more in one click than with a whole semester of absorbing knowledge from a book.

  • Clicks don't translate well. It is hard to describe the actual path up to and through a click.

  • What causes a subject to click for me will not cause it to click for another. Clicks seem to be very personal experiences, which is probably why it is so hard to translate.

  • Clicks tend to be most noticeable with large amounts of critical study. I assume that day-in-day-out clicks are not terribly noticeable but I suspect that they exist. A simple example I can think of is suddenly discovering a quicker route through town.

  • Clicks do not require large amounts of critical study, however, as I have had clicks drop on me from nowhere with all of the answers to a particular problem laying around in plain sight.

  • Once a click happens, the extra perspective appears obviously true. Clicks are often accompanied with phrases like, "Oh!" or "Why didn't I see this before?!"

  • Even for complicated subjects, it takes trivial amounts of conversation to learn if the subject has clicked in another person. Once you "get it," other people who get it know you got it.

  • Some people are much better at producing clicks in others.

  • Some people have no idea what a click is and have never felt one. Some of these people are very smart, but I seem to notice that they have a weakness for abstract thought or are more likely to be satisfied with stopping once they have accurate predictors. Perhaps learning why the model ended up being that particular model is extraneous and not needed to predict and so is an unwanted extra step.

  • Mind-dumping helps things click. I find that if I just blah on a page, start over and blah again, and repeat the process a click will probably happen at some point in the cycle.

  • There are topics that have not clicked for me yet but I suspect they would if I kept pushing them.

  • Perspectives from other people help clicks happen. Listening to someone else struggle to understand the concept helps clicks happen.

Thank you for writing this post. It's one of the topics that has kept me from participating in the discussion here - I click on things very often, as a trained and sustained act of rationality, and often find it difficult to verbalize why I feel I am right and others wrong. But when I feel that I have clicked, then I have very high confidence in my rightness, as determined by observation and many years of evidence that my clicks are, indeed, right.

I use the phrase, "My subconscious is way smarter than I am," to describe this event. My best guess is that my subconscious has built-in pathways to notice logical flaws, lack of evidence, and has already chewed through problems over many years of thought ("creating a path"?), and I have trained myself to follow these "feelings" and form them into conscious words/thoughts/actions. It seems to be related to memory and number of facts in some ways, as the more reading I have done on a topic, the better I'm able to click on related topics. I do not use the word "feeling" lightly - it really does feel like something, and it gives me a sort of built-in filter.

I click on people (small movements, small statements leading to huge understanding gains, to the point where I can literally say what they're thinking from the slightest gesture), I click on tests (memorization), I click on big topics (X-risks, shut-up-and-multiply), philosophy, etc. Quantum mechanics, I have failed to click anything, and have been avoiding.

What I've found is that my click decisions, when thought is applied, have dozens of reasons behind them, all unrealized at the time I was able to make the decision. Writing them all out afterward makes for an incredibly powerful argument in favor of my decision, and oftentimes shows that I really did weigh all the positives and negatives, just not in a rigorous 'proof'. Like not showing your work on a math problem, but still being able to look at the numbers and know the result.

One of the things I had to eliminate for my clickiness to become truly powerful was the desire to hold onto current beliefs. Openness to change is essential to letting the click take over your thoughts and lead you in a new direction. People get frustrated when arguing with me on occasion, as I will be a strong proponent of a specific position, then they present to me a single fact that demolishes it, and I will immediately begin arguing a new position using that fact as support. They typically laugh and shake their head, as if I had never supported my previous position and am now just arguing for argument's sake, when in reality, I clicked on the new fact and realized the implications, adjusting my beliefs accordingly, all in an instant.

Another thing which I've noticed I do which helps greatly with click thinking is absorb a huge amount of information on a specific topic. When I need to make an important decision, I get books from the library, I hit up google and click links out to 25+ pages of results, I check for authoritative forums and lurk there, reading, learning, rarely asking questions but picking up as much as I can none-the-less. I did this for WoW, for audio tech, for financial investment, for Singularity and rationality topics... and after I've spent a few months at integrating myself with that information center, I'm able to click like crazy on all the important things. Some topics, once I've clicked, I drop it and move on, but others I continue to practice and read, like first order philosophy. Thought experiments (roleplaying, etc.) tend to help if the topic is complex enough. I play a character in my head, or in a game, for a month or so, then when I need to ask a really important question about the topic the character was designed around, I just click to the answer without consciously thinking, because I just know. For clicking on people, this involves observation and spending time around that person, and asking lots of questions about what they're thinking (I've gotten very good at asking without seeming annoying).

In addition to being open to change and gorging on data, I've found it very important to trust yourself. And by this I don't mean, 'trust that you're making the right decision', but as an almost 'trust that other person who used your name at the time but who you don't even remember or think like any more'. In a sense, trust Rain-2007, even though I am now Rain-2010. I realize this will be counter to Eliezer's standard, "Do not listen to Eliezer-2001 - he was wrong," but that's not how I mean it. Instead, I'm saying that, at the point of information-glut and focus on a topic, I'm far more clickable than at some distant point in the future. I should trust that decision unless I'm willing to go through the same process of gather, read, learn, focus, and decide anew. That past click will be more right than any decision I make removed from that focus. It also means that you should trust your "instincts" - heresy, I know, considering the inherent biases, but a click really does "feel" different from a template-bias response.

One other thing I do, but which I'm not sure contributes to clickability, is avoid deep jargon or too-specific thinking. The click seems related to generalized thought processes rather than specific verbiage. So, for example, rather than reading and learning what Kolomogorov complexity is (probably spelled wrong - as I said, I'm avoiding this stuff), I'd rather do a roleplaying exercise where my character exists at various technology levels, and generalize the universe around them. This step may seem at odds with the information-glut step, but I combine the two - when reading, every link I check often has only one or two sentences, maybe a paragraph or a whole page, that I actually "use" as in try to retain. The rest of it, I consider useless/worthless, and discard as best I can.

Which reminds me, I also ignore / forget information in order to more carefully focus on what I'm thinking about in the present (this is part of why I have to trust my past self so much). I try not to overload myself with knowledge or memories that don't help me make decisions now or in the anticipated future. Some people find this frustrating, as I don't remember I pushed them down the stairs when I was 10, but that thing in my childhood was so different from me that I found no point in remembering much of it.

I think the click is a result of years of gathering information and thinking on (potentially general) topics, the ability to rapidly change, the ability to recognize how it feels to click, and to place the trust in that feeling that it deserves. It seems to be a trained skill, starting with (prerequisite of?) a good memory.

The one thing I'm getting out of writing this post is that the 'click' you describe is, in my opinion, not simple or a single effect, but rather a complex interaction of events, abilities, and predispositions. It may not be reproducible or trainable.

Sorry this post is late. Another part of the information-gathering strategy is to let conversations resolve themselves (wait a few days after a post) and read it all at once so points and counterpoints are all neatly together at the same time.

I had a funny click with my girlfriend earlier this evening. I suggested that she should sign up for cryonics at some point soon, and I was surprised that she was against the idea. In response to her objections, I explained it was vitrification and not freezing, etc. etc. but she wasn't giving me any rational answers, until she said that she really wanted to see the future, but she also wanted to watch the future unfold.

She thought by cryonics that I meant right now, Futurama style. After a much needed clarification she immediately agreed that cryonics was a good idea.

So based on her understanding of what you said, she was actually right to object.

I guess the lesson here is that we must learn not to skip steps in the explanation of unconventional ideas because there is a risk that people will be opposed to things that aren't even part of the proposal, and there is a further risk that we won't notice that's what is going on (in your case, you noticed it and corrected the situation, but what if there had been a huge fight and the subject had never been brought up again? That would have been a sad reason not to sign up for cryonics...).

Interesting. Eliezer took some X years to recognize that even "normal looking" persons can be quick on the uptake? ;)

My best guess is that clickiness has something to do with failure to compartmentalize - missing, or failing to use, the mental gear that lets human beings believe two contradictory things at the same time. Clicky people would tend to be people who take all of their beliefs at face value.

I guess it has a bit deeper explanation than that. I think clickiness happens if two people managed to build very similar mental models and they are ready to manipulate and modify models incrementally. Once the models are roughly in sync, it takes very little time to communicate and just slight hints can create the right change in the conversation partner's model, if he is ready to update.

I think a lot of us has been trained hard to stop model building at certain points. There is definitely a personal difference between people on how much do they care about taboos the society imposes on them which can result in mental red lights: "Don't continue building that model! It's dangerous!" This is what I think Eliezer's notion of "compartmentalization" refers to.

A lot of intelligent people have much less brakes and generally used to model building and do this uninhibitedly, can maintain several models and have fun doing that.

But in general, most people are lazy model builder, they build their models once and stick to it, or just find rationalizations to cut down on "mental effort" of generating and incrementally updating models.

However, I don't think that brakes are the only reason people don't click. If I just don't know how to build the right model (miss the know-how, experience, etc.) I won't click regardless.

For example I am not a musician and if I found it hard to have conversations with experienced musicians over music. Musicians among themselves can build very quickly models of musical concepts and click with each other. I can try to be maximally open minded, I won't manage to click. I simply fail the necessary skills to build the required models.

I propose the term "clack" to denote the opposite of "click" -- that is, resisting an obviously correct conclusion.

What the hell is in that click?

I'm not seeing that there's anything so mysterious here. From your description, to click is to realize an implication of your beliefs so quickly that you aren't conscious of the process of inference as it happens. You add that this inference should be one that most people fail to draw, even if the reasoning is presented to them explicitly.

I expect that, for this to happen, the relevant beliefs must happen to be

  1. cached in a rapidly-accessible part of your mind,

  2. stored in a form such that the conclusion is a very short inferential step beyond them, and

  3. free of any obstructing beliefs.

By an obstructing belief, I don't mean a belief contradicting the other beliefs. I mean a belief that lowers you estimate of the conditional probability of the conclusion that you would otherwise have reached.

When you are trying to induce other people to click, you can do something about (1) and (2) above. You can format the relevant beliefs in the most transparent way possible, and you can use emphasis and repetition to get the beliefs cached.

But if your interlocutors still fail to click, it's probably because (3) didn't happen. That is, it's probably just a special case of the usual reason why people fail to be convinced by an argument, even when they grant the premises. People fail to be convinced because they have other beliefs, which, when taken into account, seem to lower the overall probability of your conclusion. So, typically, a failure to click is no more mysterious than a general failure to be convinced by arguments.

On a more cynical note, I'm pretty sure that the "click" is almost the only decision procedure for the vast majority of people*. When a question arises, one answer will seem to be manifestly the right answer, and the rest will seem obviously wrong. When they change their mind, it will be because another answer abruptly seems to be manifestly the right answer. If no answer clicks for them, they will just chalk the problem up as "mysterious".


*Here I'm using "click" to include inferences that aren't necessarily rare, and which might in fact be very common.

At the risk of revealing my stupidity...

In my experience, people who don't compartmentalize tend to be cranks.

Because the world appears to contradict itself, most people act as if it does. Evolution has created many, many algorithms and hacks to help us navigate the physical and social worlds, to survive, and to reproduce. Even if we know the world doesn't really contradict itself, most of us don't have good enough meta-judgement about how to resolve the apparent inconsistencies (and don't care).

Most people who try to make all their beliefs fit with all their other beliefs, end up forcing some of the puzzle pieces into wrong-shaped holes. Their favorite part of their mental map of the world is locally consistent, but the farther-out parts are now WAY off, thus the crank-ism.

And that's just the physical world. When we get to human values, some of them REALLY ARE in conflict with others, so not only is it impossible to try to force them all to agree, but we shouldn't try (too hard). Value systems are not axiomatic. Violence to important parts of our value system can have repercussions even worse than violence to parts of our world view.

FWIW, I'm not interested in cryonics. I think it's not possible, but even if it were, I think I would not bother. Introspecting now, I'm not sure I can explain why. But it seems that natural death seems like a good point to say "enough is enough." In other words, letting what's been given be enough. And I am guessing that something similar will keep most of us uninterested in cryonics forever.

Now that I think of it, I see interest in cryonics as a kind of crankish pastime. It takes the mostly correct idea "life is good, death is bad" to such an extreme that it does violence to other valuable parts of our humanity (sorry, but I can't be more specific).

To try to head off some objections:

  • I would certainly never dream of curtailing anyone else's freedom to be cryo-preserved, and I recognize I might change my mind (I just don't think it's likely, nor worth much thought).
  • Yes, I recognize how wonderful medical science is, but I see a qualitative difference between living longer and living forever.
  • No, I don't think I will change my mind about this as my own death approaches (but I'll probably find out). Nor do I think I would change my mind if/when the death of a loved one becomes a reality.

I offer this comment, not in an attempt to change anyone's mind, but to go a little way to answer the question "Why are some people not interested in cryonics?"

Thanks!

It takes the mostly correct idea "life is good, death is bad" to such an extreme that it does violence to other valuable parts of our humanity (sorry, but I can't be more specific).

It seems to me that you can't be more specific because there is not anything there to be more specific about.

I think it's not possible, but even if it were, I think I would not bother. Introspecting now, I'm not sure I can explain why. But it seems that natural death seems like a good point to say "enough is enough." In other words, letting what's been given be enough.

-Longer life has never been given; it has always been taken. There is no giver.

-"Enough is enough" is sour grapes - "I probably don't have access to living forever, so it's easier to change my values to be happy with that than to want yet not attain it." But if it were a guarantee, and everyone else was doing it (as they would if it were a guarantee), then this position would be the equivalent to advocating suicide at some ridiculously young age in the current era.

It takes the mostly correct idea "life is good, death is bad" to such an extreme that it does violence to other valuable parts of our humanity (sorry, but I can't be more specific).

I assert that the more extremely the idea "life is good, death is bad" is held, the more benefit other valuable parts of our humanity are rendered. I can't be more specific.

(Edit: after having written this entire giant thing, I notice you saying that this was just a "why are some people not interested in cryo" comment, whereas I very much am trying to change your mind. I don't like trying to change people's minds without warning (I thought we were having that sort of discussion, but apparently we aren't), so here's warning.)

But it seems that natural death seems like a good point to say "enough is enough." In other words, letting what's been given be enough.

You're aware that your life expectancy is about 4 times that of the people who built the pyramids, even the Pharoahs, right? That assertion seems to basically be slapping all of your ancestors in the face. "I don't care that you fought and died for me to have a longer, better life; you needn't have bothered, I'm happy to die whenever". Seriously: if natural life span is good enough for you, start playing russian roulette once a year around 20 years old; the odds are about right for early humans.

As a sort-of aside, I honestly don't see a lot of difference between "when I die is fine" and just committing suicide right now. Whatever it is that would stop you from committing suicide should also stop you from wanting to die at any point in the future.

I'm aware this is a minority view, but that doesn't necessarily make it any less sensible; insert historical examples of once-popular-but-wrong views here.

Most people who try to make all their beliefs fit with all their other beliefs, end up forcing some of the puzzle pieces into wrong-shaped holes.

Then they've failed at the actual task, which is to make all of your beliefs fit with reality.

When we get to human values, some of them REALLY ARE in conflict with others,

My values are part of reality. Some of them are more important than others. Some of them contradict each other. Knowing these things is part of what lining my beliefs up with reality means: if my map of reality doesn't include the fact that some of my values contradict, it's a pretty bad map.

You seem to have confused people who are trying to force their beliefs to line up with each other (an easy path to crazy, because you can make any belief line up with any other belief simply by inserting something crazy in the middle; it's all in your head after all) with people with people who are trying to force their beliefs to line up with reality. It's a very different process.

Part of reality is that one of my most dominant values, one so dominant that almost no other values touch its power, is the desire to keep existing and to keep the other people I care about existing. I'm aware that this is selfish, and my compromise is that if reviving me will use such resources that other people would starve to death or something, I don't want to be revived (and I believe my cryo documents specify this; or maybe not, it's kind of obvious, isn't it??). I don't have any difficulty lining up this value with the rest of my values; except for pretty landscapes, everything I value has come from other humans.

In some sense, I don't try to line this, or any other value, up with reality; I'm basically a moral skeptic. I have beliefs that are composed of both values ("death is bad") and statements about reality ("cryo has a better chance of saving me from death than cremation") such that the resulting belief ("cryo is good") is subservient to both matching up with reality (although I doubt anyone will come up with evidence that cryo is less likely to keep you alive than cremation) and my values, but having values and conforming my beliefs with reality are totally separate things.

-Robin

Careful with life-expectancy figures from earlier eras. There was a great chance of dying as a baby, and a great chance for women to die of childbirth. Excluding the first -- that is, just counting those that made it to, say, 5 years old, and the life-expectancy greatly shoots up, though obviously not as high as now.

You seem to have two objections to cryonics:

  1. Cryonics won't work.

  2. Life extension is bad.

#1 is better addressed by the giant amount of information already written on the subject.

For #2 I'd like to quote a bit of Down and Out in the Magic Kingdom:

Everyone who had serious philosophical conundra on that subject just, you know, died, a generation before. The Bitchun Society didn't need to convert its detractors, just outlive them.

Even if you don't think life extension technologies are a good thing, it's only a matter of time before almost everyone thinks they are. Whatever part of "humanity" you value more than life will be gone forever.

ETA: Actually, there is an out: if you build FAI or some sort of world government and it enforces 20th century life spans on people. I can't say natural life spans because our lives were much shorter before modern sanitation and medicine.

Most people who try to make all their beliefs fit with all their other beliefs, end up forcing some of the puzzle pieces into wrong-shaped holes. Their favorite part of their mental map of the world is locally consistent, but the farther-out parts are now WAY off, thus the crank-ism.

This is not true of all non-compartmentalizers - just the ones you have noticed and remember. Rational non-compartmentalizers simply hold on to that puzzle piece that doesn't fit until they either

  • determine where it goes;

  • determine that it is not from the right puzzle; or

  • reshape it to correctly fit the puzzle.

This post, in addition to being a joy to read, contains one particular awesome insight:

My best guess is that clickiness has something to do with failure to compartmentalize - missing, or failing to use, the mental gear that lets human beings believe two contradictory things at the same time. Clicky people would tend to be people who take all of their beliefs at face value.

Here's some confirmation: I must have at least some clickiness, since I "got" the intelligence explosion/FAI/transhumanism stuff pretty much immediately, despite not having been raised on science fiction.

And, it turns out: I hate, hate, HATE compartmentalization. Just hate it -- in pretty much all its forms. For example, I have always despised the way schools divide up learning into different "classes", which you're not supposed to relate to each other. (It's particularly bad at the middle/high school level, where, if you dare to ask why you shouldn't be able to study both music and drama, or both French and Spanish, they look at you with a puzzled expression, as though such thoughts had occurred to no human being before.) I hate C.P. Snow's goddamned "Two Cultures". I hate the way mathematicians in different areas use the exact same concepts and pretend they don't by employing different notation and terminology. I hate the way music theorists invent separate theoretical universes for different historical periods.

In general, don't get me started on "separate magisteria"....

Eliezer, you're seriously onto something here.

I am puzzled by Eliezer's confidence in the rationality of signing up for cryonics given he thinks it would be characteristic of a "GODDAMNED SANE CIVILIZATION". I am even more puzzled by the commenters overwhelming agreement with Eliezer. I am personally uncomfortable with cryonics for the two following reasons and am surprised that no one seems to bring these up.

  1. I can see it being very plausible that somewhere along the line I would be subject to immense suffering, over which death would have been a far better option, but that I would be either potentially unable to take my life due to physical constraints or would lack the courage to do so (it takes quite some courage and persistent suffering to be driven to suicide IMO). I see this as analogous to a case where I am very near death and am faced with the two following options.

(a) Have my life support system turned off and die peacefully.

(b) Keep the life support system going but subsequently give up all autonomy over my life and body and place it entirely in the hands of others who are likely not even my immediate kin. I could be made to put up with immense suffering either due to technical glitches which are very likely since this is a very nascent area, or due to willful malevolence. In this case I would very likely choose (a).

  1. Note that in addition to prolonged suffering where I am effectively incapable of pulling the plug on myself, there is also the chance that I would be an oddity as far as future generations are concerned. Perhaps I would be made a circus or museum exhibit to entertain that generation. Our race is highly speciesist and I would not trust the future generations with their bionic implants and so on to even necessarily consider me to be of the same species and offer me the same rights and moral consideration.

  2. Last but not the least is a point I made as a comment in response to Robin Hanson's post. Robin Hanson expressed a preference for a world filled with more people with scarce per-capita resources compared to a world with fewer people with significantly better living conditions. His point was that this gives many people the opportunity to "be born" who would not have come into existence. And that this was for some reason a good thing. I suspect that Eliezer too has a similar opinion on this, and this is probably another place we widely differ.

    I couldn't care less if I weren't born. As the saying goes, I have been dead/not existed for billions of years and haven't suffered the slightest inconvenience. I see cryonics and a successful recovery as no different from dying and being re-born. Thus I assign virtually zero positives to being re-born, while I assign huge negatives to 1 and 2 above.

    We are evolutionarily driven to dislike dying and try to postpone it for as long as possible. However I don't think we are particularly hardwired to prefer this form of weird cryonic rebirth over never waking up at all. Given that our general preference to not die has nothing fundamental about it, but is rather a case of us following our evolutionary leanings, what makes it so obvious that cryonic rebirth is a good thing. Some form of longetivity research which extends our life to say 200 years without going the cryonic route with all the above risks especially for the first few generations of cryonic guinea pigs, seems much harder to argue against.

    Unfortunately all the discussion on this forum including the writings by Eliezer seem to draw absolutely no distinction between the two scenarios:

A. Signing up for cryonics now, with all the associated risks/benefits that I just discussed.

B. Some form of payment for some experimental longetivity research that you need to make upfront when you are 30. If the research succeeds and is tested safe, you can use the drugs for free and live to be 200. If not, you live your regular lifespan and merely forfeit the money that you paid to sponsor the research.

I can readily see myself choosing (B) if the rates were affordable and if the probability of success seemed reasonable to justify that rate. I find it astounding that repeated shallow arguments are made on this blog which address scenario (A) as though it were identical to scenario (B).

If you were hit by a car tomorrow, would you be lying there thinking, 'well, I've had a good life, and being dead's not so bad, so I'll call the funeral service' or would you be calling an ambulance?

Ambulances are expensive, and doctors are not guaranteed to be able to fix you, and there is chance you might be in for some suffering, and you may be out of society for a while until you recover - but you call them anyway. You do this because you know that being alive is better than being dead.

Cryonics is just taking this one step further., and booking your ambulance ahead of time.

I suspect that Eliezer too has a similar opinion on this

Nope, ongoing disagreement with Robin. http://lesswrong.com/lw/ws/for_the_people_who_are_still_alive/