In Defence of Simple Ideas That Explain Everything But Are Wrong

I've been thinking, and writing, about The Impossible Question of the Thyroid for some while now.

I came up with what I thought was a good stab at an answer to its majestic mystery:

http://lesswrong.com/r/discussion/lw/nef/the_thyroid_madness_core_argument_evidence/

This is a very simple and obvious explanation of an awful lot of otherwise confusing data, anecdotes, quackery, expert opinion and medical research.

People seem to hate it because it is so simple, and makes so many predictions, most of which are terrifying.

And it is obviously false! Of course medicine has tried using thyroid supplementation to fix 'tired all the time'. It doesn't work!

EDIT: Apparently I spoke too soon. GRB Skinner tried it in 2000, and it works a treat. See comments.

But there really is an awful lot unexplained about all this T4/T3 business, and why different people think it works differently. I refer you to the internet for all the unexplained things.

In just the endocrinological literature there is a long fight going on about T4/T3 ratios in thyroid supplementation, and about the question of whether or not to treat 'subclinical hypothyroidism'. Some people show symptoms with very low TSH values. Some people have extremely high TSH values and show no symptoms at all.

I've been trying various ways of explaining it all for nearly four months now. And I've found lots of magical thinking in conventional medicine, and lots of waving away of the reports of honest-sounding empiricists, real doctors, who have made no obvious errors of reasoning, most of whom are taking terrible risks with their own careers in order to, as they see it, help their patients.

I've read lots of people saying 'we tried this, and it works', and no people saying 'we tried this, and it makes no difference'. The explanation favoured by conventional medicine strongly predicts 'we tried this, and it makes no difference'. But they've never tried it!

It's really confusing. A lot of people are very confused.

I think that simple explanations are extra-worth looking at because they are simple.

Of course that doesn't mean they're right. Consequences and experiment are the only judge of that.

I do not think I am right! There is no way I can have got the whole picture. I can't explain, for instance: 'euthyroid sick syndrome'. But I don't predict that it doesn't exist either.

But you should look very carefully at the simple beautiful ideas that seem to explain everything, but that look untrue.

Firstly because Solomonoff induction looks like a good way to think about the world. Or call it Occam's Razor if you prefer. It is straightforward Bayesianism, as David Mackay points out in Information Theory, Inference, and Learning Algorithms.

Secondly because all the good ideas have turned out to be simple, and could have been spotted, (and often were) by the Ancient Greeks, and could have been demonstrated by them, if only they'd really thought about it.

Thirdly because experiments not done with the hypothesis in mind have likely neglected important aspects of the problem. (In this case T3 homeostasis, and possible peripheral resistance, and the difference between basal metabolic rate and waking rate, and the difference between core and peripheral temperature, and the possibility of a common DIO2 mutation causing people's systems to react differently to T4 monotherapy, and in general the hideous complexity of the thyroid system and its function in vertebrates in general).

Fourthly because the reason for the 'unreasonable effectiveness of mathematics' is that the simplest ideas tend to come up everywhere!

And so when a mathematician plays with a toy problem for fun, and reasons carefully about it, two thousand years later it can end up winning a major war in a way no one ever expected. 

So that even if there are things you can't explain (I can't explain hot daytime fibro-turks...), you should keep plugging away, to see if you can explain them, if you think hard enough.

Good ideas should be given extra-benefit of the doubt. Not ignored because they prove (slightly) too much!

Do not believe them. Do not ever ever believe them. You will end up worse than Hitler. You will end up worse than Marx.

But give them the benefit of the doubt. Keep them in mind. Try safe experiments, ready to abort when they go wrong.

And if they're easy to refute (mine is), then if you're going to call yourself a scientist, damned well take the trouble to refute the things. You might learn something!

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 2:05 AM
Select new highlight date
Rendering 50/53 comments  show more

I think that it would probably be a good idea to differentiate: ‘simple explanations’ and 'explanations that are based on simple rules'. See Fake Simplicity for a description of simple explanations. An example would be attributing all of the causality to some other entity, e.g. god. Explanations that are based on simple rules can sometimes also be easy to understand, but the way in which they are reached is rarely simple. They are grounded in extensive research and evidence.

Simple explanations can be dangerous because they are easy to believe. They are:

  • Easy to understand
  • Sometimes partly correct as they can be true some of the time even though they don’t describe the whole picture
  • Often overly broad so that they are hard to disprove
  • Etc.

I am just trying to saying that we should also be careful of simple explanations as well because they can be enticing. I would think that non-experts rarely have enough experience to reach explanations based on simple rules and will instead often just find simple explanations. This is because it is really hard or, perhaps, even impossible to find these simple rules without a lot of ground work. We often have to understand something intimately and deeply before we even begin to sense the undercurrent from the operation of these simple rules.

Here’s an extract from Feynman which is related:

The world is strange. The whole universe is very strange, but you see when you look at the details that the rules of the game are very simple – the mechanical rules by which you can figure out exactly what is going to happen when the situation is simple. It is like a chess game. If you are in a corner with only a few pieces involved, you can work out exactly what is going to happen, and you can always do that when there are only a few pieces. And yet in the real game there are so many pieces that you can't figure out what is going to happen – so there is a kind of hierarchy of different complexities. It is hard to believe. It is incredible! In fact, most people don't believe that the behavior of, say, me is the result of lots and lots of atoms all obeying very simple rules and evolving into such a creature that a billion years of life has produced. There is such a lot in the world. There is so much distance between the fundamental rules and the final phenomena that it is almost unbelievable that the final variety of phenomena can come from such a steady operation of such simple rules.

For the Feynman quote, I don't think Feynman was a programmer! And Chaos was late in his life. Incomprehensibly complex behaviour from simple rules is not surprising to me.

Feynman certainly wasn't a professional programmer and I don't believe he spent much time writing software, but he worked for a while as a consultant to Thinking Machines Corporation and gave a (published, rather good) set of Lectures on Computation.

So if he doesn't sound like a programmer, it may be for reasons other than not being familiar with the insights that come from spending time making software.

(I don't think Feynman had any more difficulty than you in believing that simple rules produce very complex behaviour. I think he was trying to express how most people feel about it.)

And Feynman was very good at making people understand him. His lectures are well known for that.

I thought I was reasonably comfortable with basic parallel programming... then I spent a few hours talking with a very smart woman who specialized in low level parallel programming(close to the silicon) and talking about the kind of things that can go wrong.

It's like clicking into an article expecting some light reading and finding yourself staring into a lovecraftian madness-educing abyss filled with 5-D monsters.

Something like dealing with synchronization and locking instead of just "and then we send this command to the mapper, and a lot of executors work in parallel"?

No, I was comfortable with locking and the sort of stuff you'll routinely see in high level languages where they lock away the complexity behind abstraction.

I'm talking about the "fun" of physical cores which few sane programmers touch.

Though most programmers outside of chip companies can't touch those levels nowdays since even assembly is treated like a high-level language.

http://blog.erratasec.com/2015/03/x86-is-high-level-language.html#.VvQhiOaAnSg

I had something of a similar experience writing software for a company that designed its own chips. I was writing in C, and occasionally, the programs had errors that I couldn't debug. At that point I'd dive into the Verilog for the chip and see how it was all wired up. And often that would be the problem.

It's a commonplace that the thing that determines the meaning of a computer program is itself a computer program. But it's still weird to get bitten by that fact when you're writing C.

The chip is a program, which determines the meaning of the machine code, which is a program produced by the C compiler, which is a program interpreting the program I'm writing. And whether you look at the chip as a compiled version of the verilog (compiled by another program, with silicon as the target) or as a logical program which you're proving things about in your head, or as a program being interpreted by a simulator, that's a lot of turtles.....

Perhaps, 'laws' would have been a better word than 'rules'.

I was thinking of it more in terms of complexity. When things are looked at in isolation, it is much easier to see how the simple laws apply. But as things get more complex, we also need to figure out how the different systems interact and influence each other. This makes the simple laws harder to discern.

Simple systems have few components and their behavior is in all respects fully understandable and predictable. An example would be a solid ball falling under the action of gravity through air. This simple system consists of the ball, the air, and the gravitational force. Here we usually assume a single ball, constant acceleration of gravity, a viscous drag on the ball, and Newton’s laws. When making these assumptions, we arrive at very useful answers. We did, however, neglect many aspects. If, for example, we would ask how the behavior changes when we go from one ball, to two, to three, or even more balls that fall close to each other, our “Simple System” assumption fails. It is not sufficient to generalize from one ball’s behavior to many. Instead we need to consider the interaction of the balls through their self‐generated vortices.

I thought I was reasonably comfortable with basic parallel programming... then I spent a few hours talking with a woman who specialized in low level parallel programming(close to the silicon) and the kind of things that can go wrong.

It's like clicking into an article expecting some light reading and finding yourself staring into a lovecraftian madness-educing abyss filled with 5-D monsters.

There's always the classic:

The lady down the street is a witch, she did it.

It's a fair cop.


I would so like to leave it there, but in case anyone doesn't get it, it's a quote from 'Monty Python and the Holy Grail'.

And what I mean by it is: It's not a bad idea, if you believe that the world is ruled by good and evil powers, that some people might serve evil.

The problem is that it doesn't help you find the evil-servers.

You need a witch-test.

And you need to check very carefully that it works! Or you will do immense harm. (I am looking at you, TSH)


We didn't stop torturing and burning witches because we suddenly became kind. If Satan, and witches, existed, then they would deserve every bit of it. (Obviously I speak of the mediaeval conception of witches, not the modern pagans, who are awfully nice people who care about trees and knitting)

We stopped torturing people when we realised that you can get anyone to confess to anything by torture. (I believe that experiments were conducted.)

And now, we don't believe in the Evil One, so we don't even think witches exist. (Leaving the Wicca people to play their beautiful harmless games which everyone approves of)

You need a witch-test.

Which Sir Bedevere provides :-) And after some critical inquiry, no less!

all the good ideas have turned out to be simple

Yeah, right.

[EDITED to add:] I don't disagree with the overall thrust of the post, and I agree that a lot of good scientific ideas have turned out to be simple. But that was one step too much hyperbole for me.

I'd agree that most of the best scientific ideas have been relatively simple... but that's at least partly selection bias.

Compare two possible ideas:

"People with tuberculosis should be given penicillum extract"

"People with tuberculosis should be given (2S,5R,6R)-3,3-dimethyl-7-oxo-6-(2-phenylacetamido)-4-thia-1-azabicyclo[3.2.0]heptane-2-carboxylic acid"

The first idea is no better than the second. But we'd have taken forever to come up with the second, complex idea by just sifting through all the equally-chemically-complex alternatives; we actually came up with it as a refinement of the first, much simpler (in the context of our world) idea. There are surely many even-better complex ideas out there, but searching through idea space brings you to simpler ideas earlier and so they're disproportionately represented.

And possibly the simple ideas which look true are the shadows of the more complicated truth.

And possibly they are the only path to the truths which we can find.

The puzzle in science is not really 'the unreasonable effectiveness of mathematics'.

It is 'the unreasonable effectiveness of simple ideas'.

And the puzzle, as you say, is that there have always been simple ideas to lead us to the more complicated ideas.

But as you point out, that may well have a simple explanation.

People seem to hate it because it is so simple, and makes so many predictions, most of which are terrifying.

And it is obviously false! Of course medicine has tried using thyroid supplementation to fix 'tired all the time'. It doesn't work!

That's not a coincidence.

The fact that an idea is simple and makes predictions with big implications (but supposedly has been ignored) is, all by itself, evidence that the idea is false.

Oh, I absolutely agree! What's irritating me is that that now seems to be the only reason to believe that my thyroid craziness is false.

(medical science even remotely competent) => (idea is false)

As they say, one man's modus ponens is another man's modus tollens.

It turns out I was a bit too fast with:

And it is obviously false! Of course medicine has tried using thyroid supplementation to fix 'tired all the time'. It doesn't work!

This paper:

Clinical Response to Thyroxine Sodium in Clinically Hypothyroid but Biochemically Euthyroid Patients G. R. B. SKINNER MD DSc FRCPath FRCOG, D. HOLMES, A. AHMAD PhD, J. A. DAVIES BSc and J. BENITEZ MSc Vaccine Research Trust, 22 Alcester Road, Moseley, Birmingham B13 8BE, UK

Is the report of a man who tried the blindingly obvious thing (just treating CFS patients with thyroxine, and raising the dose until they got better), which I've been saying all along can't possibly work because it is literally unbelievable that medical science can have missed this.

Apparently it worked a treat. This is from 2000. If it's been followed up (apart from the misinterpreted Scottish trial that I referenced in the first post in support of the idea), I can't find it.

I mean, look at all those letters: G. R. B. SKINNER MD DSc FRCPath FRCOG

This is not a homeopath. I am at an absolute loss to explain why this has been ignored.

Of course, like everyone else involved, Gordon Skinner is dead. What kills these people? Thyroxine overdose? What silences them? Alien lizard conspiracy pyramids? How would that even work?

This paper:

Beware the man of one study. One study, or even a couple of studies, can prove pretty much anything simply because there are so many studies that there will be lots of statistical anomalies.

But I am the man of two studies! (The scottish trial proves that thyroxine is less bad for their patient group than for healthy controls). And as far as I can tell, there are no other studies.

And an absolute fuckton of anecdotal evidence from the web and from alternative medicine, and from my own personal experience.

Now, I do not actually believe this works without a solid PCRT with a p-value much lower than 0.05, but after seeing all this, I certainly predict that a properly designed PCRT will come up with the goods.

And it affects the health of millions! These people are asleep on the job.

Following simple ideas or explanations that are mostly right will still give me good outcomes in a plurality of iterations.

I don't have infinite time to carefully consider those ideas. Being a standardly incompetent human at many things, my ability to discern truthiness by looking is subject to error.

What options do I have for differentiating between simple explanations that are correct and simple explanations that are only mostly correct, and then figuring out whether the latter are worth investigating for corner-casery / quackery / etc?

Well, pretty much by definition you'll do well following the mostly correct ideas. And when things go wrong, you'll have produced exactly the sort of surprise that (gets physicists/should get anyone who calls themselves a scientist) to say 'Oooh, that's interesting'.

So if you're lazy, go with the obvious (the world is flat), and only trouble yourself to think if you're (a) curious or (b) confounded by your bad anticipations.

Generally speaking 'What the wise ones say is (likely) true' is not a bad heuristic if you don't have the time or reason to be interested.

Simple Ideas That Explain Everything But Are Wrong?

'incentives'

I think clarity is saying: a simple idea that explains all human motivation for ever is "incentives". Although I personally am not sure that it is wrong.

Thank you. I worry that I am becoming some sort of scientistic mystic. Am I as unclear as Clarity?

If you are unclear; at least you do it with more words.

Simple Ideas That Explain Everything But Are Wrong? 'incentives'

is a very short post; makes it hard for people who don't get it to catch up. (no offence: I believe he meant it to be short to follow the rule of "simple ideas")

OK, I get it, thanks Elo.

If you believe that people don't respond to incentives, then we don't live in the same world.

If you believe that people only respond to monetary incentives, then we don't live in the same world.

The job is to work out which world we live in. Incentives is probably a big part of that!

Incentives in and of themselves explain a relationship between the incentive and a referent thing incentivised by it. It's like saying 'force' in physics, which is incompatible within a framework of mutually exclusive but comprehensively exhaustive concepts which make up a interdisciplinary modelling kit for the world, but people were cool with it (till Einstein changed that) because of their narrow focus.

I'm too stupid to understand this. Could you dumb it down for me? Are you saying that the idea of force in physics was not simple, or good, or useful, or that it didn't explain a lot of things? Or have I got the wrong end of your stick?

Force in physics was simple, good and useful, but less simply, good and useful that relativity, which doesn't require 'force' as an explanatory mechanism because it doesn't explain a lot of things.