Serious Stories

Value Theory

Every Utopia ever constructed—in philosophy, fiction, or religion—has been, to one degree or another, a place where you wouldn't actually want to live.  I am not alone in this important observation:  George Orwell said much the same thing in "Why Socialists Don't Believe In Fun", and I expect that many others said it earlier.

If you read books on How To Write—and there are a lot of books out there on How To Write, because amazingly a lot of book-writers think they know something about writing—these books will tell you that stories must contain "conflict".

That is, the more lukewarm sort of instructional book will tell you that stories contain "conflict".  But some authors speak more plainly.

"Stories are about people's pain."  Orson Scott Card.

"Every scene must end in disaster."  Jack Bickham.

In the age of my youthful folly, I took for granted that authors were excused from the search for true Eutopia, because if you constructed a Utopia that wasn't flawed... what stories could you write, set there?  "Once upon a time they lived happily ever after."  What use would it be for a science-fiction author to try to depict a positive Singularity, when a positive Singularity would be...

...the end of all stories?

It seemed like a reasonable framework with which to examine the literary problem of Utopia, but something about that final conclusion produced a quiet, nagging doubt.

At that time I was thinking of an AI as being something like a safe wish-granting genie for the use of individuals.  So the conclusion did make a kind of sense.  If there was a problem, you would just wish it away, right?  Ergo—no stories.  So I ignored the quiet, nagging doubt.

Much later, after I concluded that even a safe genie wasn't such a good idea, it also seemed in retrospect that "no stories" could have been a productive indicator.  On this particular occasion, "I can't think of a single story I'd want to read about this scenario", might indeed have pointed me toward the reason "I wouldn't want to actually live in this scenario".

So I swallowed my trained-in revulsion of Luddism and theodicy, and at least tried to contemplate the argument:

  • A world in which nothing ever goes wrong, or no one ever experiences any pain or sorrow, is a world containing no stories worth reading about.
  • A world that you wouldn't want to read about is a world where you wouldn't want to live.
  • Into each eudaimonic life a little pain must fall.  QED.

In one sense, it's clear that we do not want to live the sort of lives that are depicted in most stories that human authors have written so far.  Think of the truly great stories, the ones that have become legendary for being the very best of the best of their genre:  The Iliiad, Romeo and Juliet, The Godfather, Watchmen, Planescape: Torment, the second season of Buffy the Vampire Slayer, or that ending in Tsukihime.  Is there a single story on the list that isn't tragic?

Ordinarily, we prefer pleasure to pain, joy to sadness, and life to death.  Yet it seems we prefer to empathize with hurting, sad, dead characters.  Or stories about happier people aren't serious, aren't artistically great enough to be worthy of praise—but then why selectively praise stories containing unhappy people?  Is there some hidden benefit to us in it?  It's a puzzle either way you look at it.

When I was a child I couldn't write fiction because I wrote things to go well for my characters—just like I wanted things to go well in real life.  Which I was cured of by Orson Scott Card:  Oh, I said to myself, that's what I've been doing wrong, my characters aren't hurting.  Even then, I didn't realize that the microstructure of a plot works the same way—until Jack Bickham said that every scene must end in disaster.  Here I'd been trying to set up problems and resolve them, instead of making them worse...

You simply don't optimize a story the way you optimize a real life.  The best story and the best life will be produced by different criteria.

In the real world, people can go on living for quite a while without any major disasters, and still seem to do pretty okay.  When was the last time you were shot at by assassins?  Quite a while, right?  Does your life seem emptier for it?

But on the other hand...

For some odd reason, when authors get too old or too successful, they revert to my childhood.  Their stories start going right.  They stop doing horrible things to their characters, with the result that they start doing horrible things to their readers.  It seems to be a regular part of Elder Author Syndrome.  Mercedes Lackey, Laurell K. Hamilton, Robert Heinlein, even Orson Scott bloody Card—they all went that way.  They forgot how to hurt their characters.  I don't know why.

And when you read a story by an Elder Author or a pure novice—a story where things just relentlessly go right one after another—where the main character defeats the supervillain with a snap of the fingers, or even worse, before the final battle, the supervillain gives up and apologizes and then they're friends again—

It's like a fingernail scraping on a blackboard at the base of your spine.  If you've never actually read a story like that (or worse, written one) then count yourself lucky.

That fingernail-scraping quality—would it transfer over from the story to real life, if you tried living real life without a single drop of rain?

One answer might be that what a story really needs is not "disaster", or "pain", or even "conflict", but simply striving.  That the problem with Mary Sue stories is that there's not enough striving in them, but they wouldn't actually need pain.  This might, perhaps, be tested.

An alternative answer might be that this is the transhumanist version of Fun Theory we're talking about.  So we can reply, "Modify brains to eliminate that fingernail-scraping feeling", unless there's some justification for keeping it.  If the fingernail-scraping feeling is a pointless random bug getting in the way of Utopia, delete it.

Maybe we should.  Maybe all the Great Stories are tragedies because... well...

I once read that in the BDSM community, "intense sensation" is a euphemism for pain.  Upon reading this, it occurred to me that, the way humans are constructed now, it is just easier to produce pain than pleasure.  Though I speak here somewhat outside my experience, I expect that it takes a highly talented and experienced sexual artist working for hours to produce a good feeling as intense as the pain of one strong kick in the testicles—which is doable in seconds by a novice.

Investigating the life of the priest and proto-rationalist Friedrich Spee von Langenfeld, who heard the confessions of accused witches, I looked up some of the instruments that had been used to produce confessions.  There is no ordinary way to make a human being feel as good as those instruments would make you hurt.  I'm not sure even drugs would do it, though my experience of drugs is as nonexistent as my experience of torture.

There's something imbalanced about that.

Yes, human beings are too optimistic in their planning.  If losses weren't more aversive than gains, we'd go broke, the way we're constructed now.  The experimental rule is that losing a desideratum—$50, a coffee mug, whatever—hurts between 2 and 2.5 times as much as the equivalent gain.

But this is a deeper imbalance than that.  The effort-in/intensity-out difference between sex and torture is not a mere factor of 2.

If someone goes in search of sensation—in this world, the way human beings are constructed now—it's not surprising that they should arrive at pains to be mixed into their pleasures as a source of intensity in the combined experience.

If only people were constructed differently, so that you could produce pleasure as intense and in as many different flavors as pain!  If only you could, with the same ingenuity and effort as a torturer of the Inquisition, make someone feel as good as the Inquisition's victims felt bad

But then, what is the analogous pleasure that feels that good?  A victim of skillful torture will do anything to stop the pain and anything to prevent it from being repeated.  Is the equivalent pleasure one that overrides everything with the demand to continue and repeat it?  If people are stronger-willed to bear the pleasure, is it really the same pleasure?

There is another rule of writing which states that stories have to shout.  A human brain is a long way off those printed letters.  Every event and feeling needs to take place at ten times natural volume in order to have any impact at all.  You must not try to make your characters behave or feel realistically —especially, you must not faithfully reproduce your own past experiences—because without exaggeration, they'll be too quiet to rise from the page.

Maybe all the Great Stories are tragedies because happiness can't shout loud enough—to a human reader.

Maybe that's what needs fixing.

And if it were fixed... would there be any use left for pain or sorrow?  For even the memory of sadness, if all things were already as good as they could be, and every remediable ill already remedied?

Can you just delete pain outright?  Or does removing the old floor of the utility function just create a new floor?  Will any pleasure less than 10,000,000 hedons be the new unbearable pain?

Humans, built the way we are now, do seem to have hedonic scaling tendencies.  Someone who can remember starving will appreciate a loaf of bread more than someone who's never known anything but cake.  This was George Orwell's hypothesis for why Utopia is impossible in literature and reality:

"It would seem that human beings are not able to describe, nor perhaps to imagine, happiness except in terms of contrast...  The inability of mankind to imagine happiness except in the form of relief, either from effort or pain, presents Socialists with a serious problem. Dickens can describe a poverty-stricken family tucking into a roast goose, and can make them appear happy; on the other hand, the inhabitants of perfect universes seem to have no spontaneous gaiety and are usually somewhat repulsive into the bargain."

For an expected utility maximizer, rescaling the utility function to add a trillion to all outcomes is meaningless—it's literally the same utility function, as a mathematical object.  A utility function describes the relative intervals between outcomes; that's what it is, mathematically speaking.

But the human brain has distinct neural circuits for positive feedback and negative feedback, and different varieties of positive and negative feedback.  There are people today who "suffer" from congenital analgesia—a total absence of pain.  I never heard that insufficient pleasure becomes intolerable to them.

Congenital analgesics do have to inspect themselves carefully and frequently to see if they've cut themselves or burned a finger.  Pain serves a purpose in the human mind design...

But that does not show there's no alternative which could serve the same purpose.  Could you delete pain and replace it with an urge not to do certain things that lacked the intolerable subjective quality of pain?  I do not know all the Law that governs here, but I'd have to guess that yes, you could; you could replace that side of yourself with something more akin to an expected utility maximizer.

Could you delete the human tendency to scale pleasures—delete the accomodation, so that each new roast goose is as delightful as the last?  I would guess that you could.  This verges perilously close to deleting Boredom, which is right up there with Sympathy as an absolute indispensable... but to say that an old solution remains as pleasurable, is not to say that you will lose the urge to seek new and better solutions.

Can you make every roast goose as pleasurable as it would be in contrast to starvation, without ever having starved?

Can you prevent the pain of a dust speck irritating your eye from being the new torture, if you've literally never experienced anything worse than a dust speck irritating your eye?

Such questions begin to exceed my grasp of the Law, but I would guess that the answer is: yes, it can be done.  It is my experience in such matters that once you do learn the Law, you can usually see how to do weird-seeming things.

So far as I know or can guess, David Pearce (The Hedonistic Imperative) is very probably right about the feasibility part, when he says:

"Nanotechnology and genetic engineering will abolish suffering in all sentient life.  The abolitionist project is hugely ambitious but technically feasible.  It is also instrumentally rational and morally urgent.  The metabolic pathways of pain and malaise evolved because they served the fitness of our genes in the ancestral environment.  They will be replaced by a different sort of neural architecture—a motivational system based on heritable gradients of bliss.  States of sublime well-being are destined to become the genetically pre-programmed norm of mental health.  It is predicted that the world's last unpleasant experience will be a precisely dateable event."

Is that... what we want?

To just wipe away the last tear, and be done?

Is there any good reason not to, except status quo bias and a handful of worn rationalizations?

What would be the alternative?  Or alternatives?

To leave things as they are?  Of course not.  No God designed this world; we have no reason to think it exactly optimal on any dimension.  If this world does not contain too much pain, then it must not contain enough, and the latter seems unlikely.

But perhaps...

You could cut out just the intolerable parts of pain?

Get rid of the Inquisition.  Keep the sort of pain that tells you not to stick your finger in the fire, or the pain that tells you that you shouldn't have put your friend's finger in the fire, or even the pain of breaking up with a lover.

Try to get rid of the sort of pain that grinds down and destroys a mind.  Or configure minds to be harder to damage.

You could have a world where there were broken legs, or even broken hearts, but no broken people.  No child sexual abuse that turns out more abusers.  No people ground down by weariness and drudging minor inconvenience to the point where they contemplate suicide.  No random meaningless endless sorrows like starvation or AIDS.

And if even a broken leg still seems too scary—

Would we be less frightened of pain, if we were stronger, if our daily lives did not already exhaust so much of our reserves?

So that would be one alternative to the Pearce's world—if there are yet other alternatives, I haven't thought them through in any detail.

The path of courage, you might call it—the idea being that if you eliminate the destroying kind of pain and strengthen the people, then what's left shouldn't be that scary.

A world where there is sorrow, but not massive systematic pointless sorrow, like we see on the evening news.  A world where pain, if it is not eliminated, at least does not overbalance pleasure.  You could write stories about that world, and they could read our stories.

I do tend to be rather conservative around the notion of deleting large parts of human nature.  I'm not sure how many major chunks you can delete until that balanced, conflicting, dynamic structure collapses into something simpler, like an expected pleasure maximizer.

And so I do admit that it is the path of courage that appeals to me.

Then again, I haven't lived it both ways.

Maybe I'm just afraid of a world so different as Analgesia—wouldn't that be an ironic reason to walk "the path of courage"?

Maybe the path of courage just seems like the smaller change—maybe I just have trouble empathizing over a larger gap.

But "change" is a moving target.

If a human child grew up in a less painful world—if they had never lived in a world of AIDS or cancer or slavery, and so did not know these things as evils that had been triumphantly eliminated—and so did not feel that they were "already done" or that the world was "already changed enough"...

Would they take the next step, and try to eliminate the unbearable pain of broken hearts, when someone's lover stops loving them?

And then what?  Is there a point where Romeo and Juliet just seems less and less relevant, more and more a relic of some distant forgotten world?  Does there come some point in the transhuman journey where the whole business of the negative reinforcement circuitry, can't possibly seem like anything except a pointless hangover to wake up from?

And if so, is there any point in delaying that last step?  Or should we just throw away our fears and... throw away our fears?

I don't know.

 

Part of The Fun Theory Sequence

Next post: "Eutopia is Scary"

Previous post: "Emotional Involvement"

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 7:08 AM
Select new highlight date
All comments loaded

Is there a point where Romeo and Juliet just seems less and less relevant, more and more a relic of some distant forgotten world?

Aren't we already there for people who know the details rather than the outline? She was thirteen, they knew each other for less than a week, and he spent Act One mooning about a different girl. We no longer consider romantic difficulties between college boys and middle school girls to be the pinnacle of tragedy.

While we are arguing fictional evidence, I will take the third season of Buffy as its pinnacle, and that ends in triumph rather than tragedy (although again triumph over adversity). It might say more about your preferences if you think all the great works are tragedies; I know someone who thinks the sixth season of Buffy was the best, which is definitely a statement on her sense of life.

Discussion of stories without pain for the characters

I think there'd be no cost to eliminating PTSD. Not everyone gets it from a given trauma, and vulnerability to it goes up with repeated traumas, so not getting PTSD seems to be well within the human range, and getting it doesn't have any obvious advantages.

One of my friends describes one of the worst things about pain is that it's boring-- she has a bad hip. The pain from it is enough sometimes that she can't think about anything else.

Pain like that-- or worse-- all the time might well be mind-breaking.

World without pain? The good news is that if you allow individual autonomy, everyone isn't going to try giving up pain at the same time. There will be a chance to observe the effects on the early adopters.

Without pain can there be heroism?

If you want to save anyone from really serious trouble, act now, your window of opportunity won't last forever.

Are you sure you've got the causation right there? Couldn't it be that abusive people are likely to be related to other abusive people?

Certainly not all abused children become abusers, and people are indeed more resilient than some myths would have it. But TGGP, if we're going to be all evo-psych anyway, then it's often stepchildren who get abused. If they tend not to continue the cycle of abuse, that would certainly be news to me.

This is a less serious criticism of Eliezer than the others, but it's funny how often people go on about this rather easily preventable disease

AIDS goes on grinding you down - separating you from other people socially, even. Most cancers kill you quicker.

AIDS goes on grinding you down - separating you from other people socially, even. Most cancers kill you quicker.

If you have the good fortune of being wealthy, AIDS is slowly becoming more and more like contagious diabetes rather than something that robs your (now shortened) years of most of their meaning.

But that just means we're achieving the transhuman goal by pieces. AIDS is no longer the terrible disease it once was... and one day it won't be a disease at all.

If a human child grew up in a less painful world - if they had never lived in a world of AIDS or cancer or slavery, and so did not know these things as evils that had been triumphantly eliminated - and so did not feel that they were "already done" or that the world was "already changed enough"... Would they take the next step, and try to eliminate the unbearable pain of broken hearts, when someone's lover stops loving them?

Here is a more instructive thought experiment. Suppose a human child grew up in a painless world and did not feel that pain was already there or that the world had already changed enough. Should she try to create, in that possible world, the kind of pain that Eliezer doesn't think we should destroy in the actual world?

Ancient conversation on #sl4 (ran across it when checking my quotesfile):

<yed> brings up the important fear, of not knowing what to do when everything is easy, nothing to resist and conquer. <outlawpoet> if people aren't interested in intellectual pursuits, then they'll sit on earth eating 95 billion potato chips a second and playing quake 9 <Michael^2> if not having problems around to solve turns out to be a problem, then that problem too will quickly be solved <Michael^2> existential dead ends only happen when someone's imagination runs out <outlawpoet> yed, are you just trying find the downside to solving all major human problems, or what? <outlawpoet> people don't really like pain. <outlawpoet> removing it won't make them unhappy. <yed> outlaw, did you read prime-intellect? <outlawpoet> yeah. I read ender's game too, should i be afraid of insectoid aliens?

TGGP: why are you opposed to the idea that we may want to retain parts of pain?

If we could get rid of the 'painfulness' of pain, and keep the informative part of pain, that'd be ideal. With no pain at all, we're in the situation of someone with nerve damage who might lose a limb to gangrene when she accidentally damages something but doesn't notice it. (Anyone for The Chronicles of Thomas Covenant, the Unbeliever?)

Painless pain isn't all that strange an idea:

'The second pain pathway is a much more recent scientific discovery. It runs parallel to the sensory pathway, but isn't necessarily rooted in signals from the body. The breakthrough came when neurologists discovered a group of people who, after a brain injury, were no longer bothered by pain. They still felt the pain, and could accurately describe its location and intensity, but didn't seem to mind it at all. The agony wasn't agonizing.

This strange condition - it's known as pain asymbolia - results from damage to a specific subset of brain areas, like the amygdala, insula and anterior cingulate cortex, that are involved in the processing of emotions. As a result, these people are missing the negative feelings that normally accompany our painful sensations. Their muted response to bodily injury demonstrates that it is our feelings about pain - and not the pain sensation itself - that make the experience of pain so awful. Take away the emotion and a stubbed toe isn't so bad.' http://scienceblogs.com/cortex/2009/01/back_pain.php

On the other hand, there must be some downside to pain asymbolia, or we'd all have it. (Plainly the mutation exists; why isn't it selected for?)

Because a child who doesn't find pain unpleasant is really, really handicapped, even in the modern world. The people who founded A Gift of Pain had a daughter with pain asymbolia who is now mostly blind, amongst other disabilities, through self-inflicted damage. I'm not sure whether leprosy sufferers have the no-pain or no-suffering version of pain insensitivity (I think the former) but apparently it's the reason they suffer such damage.

This book seems to be a useful source for people considering the question of whether pain could be improved.

Probably because the negative feelings about the pain are what strongly motivate you to avoid it, and hence avoid physical damage.

Aaron, sad as it may seem to say, I think George Orwell's imagination simply failed him at the last. As Orwell also wrote:

In the last part, in contrast with disgusting Yahoos, we are shown the noble Houyhnhnms, intelligent horses who are free from human failings. Now these horses, for all their high character and unfailing common sense, are remarkably dreary creatures. Like the inhabitants of various other Utopias, they are chiefly concerned with avoiding fuss. They live uneventful, subdued, 'reasonable' lives, free not only from quarrels, disorder or insecurity of any kind, but also from 'passion', including physical love. They choose their mates on eugenic principles, avoid excesses of affection, and appear somewhat glad to die when their time comes. In the earlier parts of the book Swift has shown where man's folly and scoundrelism lead him: but take away the folly and scoundrelism, and all you are left with, apparently, is a tepid sort of existence, hardly worth leading.

If what Orwell wanted was a sense of "human brotherhood" in place of "swindling", he needed to say more clearly what distinguishes that from the Houyhnhnms or McCarthy's "ants marching in a circle". I am left with the impression that he ducked out a very serious problem and concluded his essay with an applause light, when applause lights were the whole problem behind tepid, watery utopias in the first place.

It's generally easier to point out problems than to find solutions. A sense of human siblinghood, that sounds like a fine thing to me - such a sense as space enthusiasts or existential risk preventers have - but if that's instead of human conflicts, because everyone just wants to help each other out so much...

Did Orwell ever write a story about his world of "human brotherhood"? Was it any good? Why not, if a world like Orwell was envisioning would have more interesting inhabitants than the Houyhnhnms?

Is that... what we want?

To just wipe away the last tear, and be done? For the last time, yes! Wake up from the Dragon-Tyrant's spell!

You could cut out just the intolerable parts of pain? It is all tolerable. Or intolerable. You'd better define your terms.

Keep the sort of pain that tells you not to stick your finger in the fire Just regenerate the finger.

grinds down and destroys a mind Does pain actually do that? Have we done experiments showing that's the case?

Or configure minds to be harder to damage One of Judith Harris' points is that minds are designed to be resilient, which is why child abuse doesn't have the effect many assume it does.

No child sexual abuse that turns out more abusers. Are you sure you've got the causation right there? Couldn't it be that abusive people are likely to be related to other abusive people?

or AIDS This is a less serious criticism of Eliezer than the others, but it's funny how often people go on about this rather easily preventable disease that kills a lot fewer people than diseases that get much less attention (various tropical diseases in Africa, a huge list of cancers in the U.S). Other diseases need better marketing and market segmentation research.

Is there a point where Romeo and Juliet just seems less and less relevant, more and more a relic of some distant forgotten world Eliminating out-group hatred alone would do that.

"I sense damage. The data could be called pain." -- The Terminator, who is not wired like humans.

I'd say the primary bad thing about pain is not that it hurts, but that it's pushy and won't tune out. You could learn to sleep in a ship's engine room, but a mere stubbed toe grabs and holds your attention.

That, I think we could delete with impunity.

At one point it was thought that it would be a good idea to shut off pain, replacing it, perhaps, with some sort of warning message. Then it was discovered that pain was the warning message, and to remove it carried the danger of apparent invulnerability. The best that could be done was to make the message less... distracting.

--Sam Hughes, Fine Structure

…One could imagine a conscious nervous system that operates as humans do but does not suffer any internal strife. In such a system, knowledge guiding skeletomotor action would be isomorphic to, and never at odds with, the nature of the phenomenal state — running across the hot desert sand in order to reach water would actually feel good, because performing the action is deemed adaptive. Why our nervous system does not operate with such harmony is perhaps a question that only evolutionary biology can answer. Certainly one can imagine such integration occurring without anything like phenomenal states, but from the present standpoint, this reflects more one’s powers of imagination than what has occurred in the course of evolutionary history.

From a nonfictional paper.

I'm surprised that none of the other commenters suggested "What if you just invert the human sense of pain, causing it to become a new form of pleasure, and then write stories about that?"

You might think that would turn a horribly tragic story into a deliciously pornographic story, but I've personally tried this trick, and it doesn't seem to work well. When the story keeps reminding you that the people are in fact suffering, and not at all enjoying the experiences, then it's hard to keep imagining the pain being inverted as pleasure.

But if you wrote a story in which it was made explicit that the people find this inverted pain to be intensely pleasurable... lots of twisted possibilities instantly spring to mind.

For example, involving fully immersive virtual realities in which there is no threat of actually dying, massively multiplayer games, a creative assortment of tools, respawning after death, the ability to record particularly "high-scoring" sessions to play back and experience later, "cheaters" who do silly things like just turn on invincibility and dive into a fire...

Should I feel guilty about all of these ideas coming to mind so easily? What if I imagined what this guilt would feel like if it was inverted?

On a related topic, there is a genre where you're allowed to write stories in which nothing bad happens to any of the characters. That genre is called "pornography".

I especially enjoy the beautiful kinky transhuman sex scenes that already exist in sci-fi literature. I <3 Greg Egan :D

I, for one, would like to see more erotic fiction set in a positive, transhuman future. A Utopia. Or better yet, a Weirdtopia! :D

I have made some attempts to write such fiction myself, but I kept trying to make it too realistic, and just ended up with something like "Peer's exoself finishes the latest set of modifications to Peer's mind, and turns the Orgasmotron back on, causing Peer to experience yet another orgasm, which is both far more intensely powerful, and far more subtly nuanced, then anything ever dreamed possible by an unaugmented human mind. And also unlike anything Peer had experienced before this latest set of modifications."

Oh, and if anyone shares these tastes and would like to meet me for some beautiful kinky transhuman sex in Second Life, you can find me by searching for "Peer Infinity". :)

(Note to self: read through my old Second Life chat logs, and see if any of my previous beautiful kinky transhuman lovemaking sessions would make good short erotic stories...)

You haven't dove deep enough into asstr yet. Some of them are truly transhuman, most of them are more like, "We terraformed a dozen planets or so, now we need to fill them up! And the best way is to start early, therefore pedo incest is the way of the future."

that's awesome! thanks! do you have links to any of these stories? you can send them by private message if you prefer. :)

and yay for someone daring to write a story about transhuman pedo incest :)

but maybe I shouldn't say that until I actually read the story. pedo incest is really hard to write a story about without it feeling all evil and squicky.

The final chapter of Metamorphosis of Prime Intellect is an example of how to do it right. Though in that story it wasn't actually pedophilia, there were practical reasons why the incest was necessary. They were trying to repopulate a planet starting with only 2 people, and they were trying to maximize genetic diversity. heh, and compared to the evilsquickiness of the other chapters, that last chapter felt almost wholesome by comparison...

Also, I should make it clear that this is not a general endorsement of incest or pedophilia. Incest and pedophilia are extremely dangerous. Though I wouldn't be too quick to label them as so evil that incestuous or underage sex should never hapen ever ever. That last chapter of MoPI shows an example of when underage incest is the lesser of two evils... and the way it's portrayed in the story, I'm not sure if I would even call it evil. To me, that scene felt mostly pure and inocent, though I happen to be kinda creepy that way. Anyway, I've already gotten myself into lots of trouble by writing this, I had better stop writing now...

Edit: yeah, I know that this is likely to get lots of downvotes, and will probably make most readers really uncomfortable, and give me a really bad reputation, but I'm still undecided about whether censoring this would be a bad idea...

Though I speak here somewhat outside my experience, I expect that it takes a highly talented and experienced sexual artist working for hours to produce a good feeling as intense as the pain of one strong kick in the testicles - which is doable in seconds by a novice.

True. I always believed that it takes much more skill to make people laugh than it takes to make them cry or suffer, which, I guess, would put comedians above most fiction authors.

In one sense, it's clear that we do not want to live the sort of lives that are depicted in most stories that human authors have written so far. Think of the truly great stories, the ones that have become legendary for being the very best of the best of their genre: The Iliad, Romeo and Juliet, The Godfather, Watchmen, Planescape: Torment, the second season of Buffy the Vampire Slayer, or that ending in Tsukihime. Is there a single story on the list that isn't tragic?

In many stories, things go horribly wrong and characters hurt, badly, but in the end, things end up much better than they started. As you say later, it's often more about the striving than the suffering. Currently, The Shawshank Redemption is sitting at the top of the IMDB Top 250 Movies list. Is that a tragic story? It does have a happy ending, after all.

Incidentally, my favorite movies to watch over and over tend to be comedies. Are Blazing Saddles, Airplane!, and Monty Python and the Holy Grail capital-G Great? How about the works of Gilbert and Sullivan? Mark Twain wrote comedies, and Don Quixote is a comedy, too!

I suspect that comedies tend to be more culture-specific than tragedies; things that were hilarious 300 years ago might just get yawns and blank stares today. On the other hand, some comedies do stand the test of time, they're just a bit less common. Lysistrata is over 2000 years old and it hasn't stopped being funny yet, and Don Quixote outlasted the entire genre of stories it was making fun of.

"Would they take the next step, and try to eliminate the unbearable pain of broken hearts, when someone's lover stops loving them?"

We already have an (admittedly limited) counterexample to this, in that many Westerners choose to seek out and do somewhat painful things (eg., climbing Everest), even when they are perfectly capable of choosing to avoid them, and even at considerable monetary cost.

Towards the end of the essay, Orwell writes:

"The real objective of Socialism is human brotherhood. This is widely felt to be the case, though it is not usually said, or not said loudly enough. Men use up their lives in heart-breaking political struggles, or get themselves killed in civil wars, or tortured in the secret prisons of the Gestapo, not in order to establish some central-heated, air-conditioned, strip-lighted Paradise, but because they want a world in which human beings love one another instead of swindling and murdering one another. And they want that world as a first step. Where they go from there is not so certain, and the attempt to foresee it in detail merely confuses the issue."

Is there a similar transhumanist objective? Is trying to see everything in detail causing confusion?

I was told Romeo and Juliet was conceived as a Black Comedy, and indeed the protagonists seem to firmly grasp the Idiot Ball throughout the story. It was revived in the Elizabethan Britain as a tragedy because Romeo and Juliet seemed to embody the weird "morality" and sensitivity of that era.

Eliezer, are you asking if we think universal boredom is a worse fate than world suffering? ;) How terribly emo of you.

Also, you seem to be describe pleasure and pain as a sliding scale- moving towards pleasure means moving away from pain. But there are already humans where that isn't the case, where pain bleeds into pleasure. People whose humiliation makes them proud, whose submission gives them control. Do they sound bored to you? (That brief foray into BDSM was incredibly simplistic. Naughty boy.)

Cory Doctorow's Down and Out in the Magic Kingdom is a pretty good utopia. Also, I would happily live in the extreme post-singularity of complete AI control off all matter and energy from The Metamorphosis of Prime Intellect.

Doctorow's Utopia has few drawbacks that don't exist in modern society, and Metamorphosis is an issue of what friendly AI means. Eliezer, you'd probably like Metamorphosis if you haven't read it -- it's about an obscenely strong AI programmed to follow Asimov's three laws. It touches on a number of issues that you write about here, like orgasmium.

Both are available for free online, Doctorow's under a CC license and localroger's free as in beer.

http://craphound.com/down/

http://www.kuro5hin.org/prime-intellect/

I enjoyed Down and Out in the Magic Kingdom quite a bit! I'm glad Kevin7 posted this link.

However, the insanity portrayed as being beneficial and desirable in The Metamorphosis is too egregious to ignore - even if the rest of the story had made good on its promise of providing an interesting look at a posthuman world. (It doesn't. We don't even get to see anything of it.) At first, I thought "oh, great; more cached-thought SF"... but it was worse than that. I forced myself to finish it just so I could be sure the following is accurate.

Worse than the already-irritating "death gives meaning to life!" reasoning replete in the work, we find either actual insanity or just a blithe disregard for self-contradiction:

  • Technology is bad, because one day the universe will die. (What's the connection? No fucking clue.)
  • We should live like cavemen, because technology (and knowledge itself - no reading!) will lead to murder (but certain arbitrary tools are okay); but death is fine when it's a bear or disease that kills you.
  • Reality isn't "really real" if it's created or controlled by an AI, even if it's indistinguishable from... uh... other reality.
  • And, of course, we save the most obvious conclusion for last (sorta-spoiler warning): despite item #2, it's okay to murder billions of happy immortals because you're unhappy that life is safe and everyone is free at last.

Merits as a story? Well, at first, it's even a little exciting, as we are treated to a glimpse of a post-Singularity world (the only glimpse we get, as it turns out), and then some backstory on how the AI was created. That's cool; but after that, it's not worth reading, in this reader's humble opinion. It's very formulaic, the characters (all ~three of them) have no personality (unless you count angst), and any technical or imaginative details that might be interesting are... well, either not there at all, or waved away with the magic Correlation Effect Plot Device. (It's first used to explain one thing, then turns out to do, quite literally, everything.)

I would like to contrast this to John Wright's The Golden Age trilogy. That work is replete with interesting ideas and details about how a Far Future society might look and work; no magic one-size-fits-all Plotonium (to coin a term; I'm sure TVTropes already has one, though) here. In Metamorphosis, we aren't really given any glimpse at society, but what we do see is essentially Now Except With Magic Powers. In The Golden Age, it is immediately obvious we aren't in Kansas any more. Metamorphosis explores one idea - AI - and that, poorly; The Golden Age includes nanotech, simulation, self-modification, the problem of willpower (see: Werewolf Contracts), posthumans, post-posthumans, post-/trans-human art, and more. Check it out if you have transhumanist leanings... or just enjoy science fiction, come to that.

Have you read The Worthing Saga by Orson Scott Card? It's one of my favorite books of his and deals with a world in which a few humans with special power act as gods and watch over everyone, not allowing any pain. One day these "gods" decide that such a world has no stories, and they stop acting as gods, allowing the people to experience pain. (The book contains may of Orson Scott Card's earliest stories, I believe, certainly from before he started from Older Author Syndrome.)

Eliezer:

I am starting to be sort of frightened by your premises - especially considering that there is non-zero probablity of creating some nonsentient singleton that tries to realize your values.

Before going any further, I STRONGLY suggest that you think AGAIN what might be interesting in carving wooden legs.

Yes, I like to SEE MOVIES with strong main characters going through the hell. But I would not want any of that.

It does not matter that AI can do everything better than me. Right now, I am not the best carving the wood either. But working with wood is still fun. Or swimming, skiing, playing chess (despite the fact computer can beat you each time), caring about animals etc.

I do not need to do dangerous things to be happy. I am definitely sure about that.

It is important to note that while emotions are triggered by relative perceptions, they are not themselves relative -- and what they are triggered by can be changed.

Tony Robbins tells an interesting story of how a class he was teaching kept being interrupted by a train thundering past (this was before he made enough money to be booked in nicer venues). After he and the class had been annoyed by it for a while, he announced a new rule: when the train passes, it's time to celebrate!

They then proceeded to cheer and whoop and jump up and down like crazy people every time the train passed... and everybody smiled and laughed and had a good time.

Not all emotional engineering is this trivial, I'll admit -- but it hardly requires a transhuman Power to do.

Physical pain and torture, I'll agree with you on: let's get that stuff out of the genome right quick. But emotional pain is something we already have the tools to get rid of. Really, status-quo bias is the only thing keeping us from virtually wiping out emotional suffering within a single generation.

Why are you biased toward the status quo for this human desire for "meaning" or "intensity" (both of which boil down to "emotional motivation"). The vast majority of terminal goals that I can imagine can be better pursued if fewer people (in the wide sense; people = sentient actors) are struggling to have an effect on the universe because they're more afraid of meaninglessness than of doing harm.

I suspect climbing Everest is much more about effort and adventure than about actual pain. Also, the vast majority of people don't do that sort of thing as far as I know.

Is there any value in heroism other than that it (attempts to) cease (some) pain (for some, at the expense of the actor)?

And if so, is there any point in delaying that last step? Or should we just throw away our fears and... throw away our fears?

Because as you would say, growing stronger is fun. Slowly, and with much effort, throwing away your fears one by one seems like a potentially rich mine of fun for a mind. At the very least it sounds like a good story.

Pablo's analogy is very thought-provoking and the best argument I've heard for ending suffering.

If pain were 'programmable', rather than delete it altogether, how about a shorter half-life ? Your finger still hurts when you stick it in the fire, but for hours or minutes afterwards rather than days ?

David Pearce has written extensively on the topic of the elimination of suffering - e.g. see: THE ABOLITIONIST PROJECT and Paradise Engineering.

Yudkowski, I'm going to have to disagree with you on the intensity of pleasure. Done properly, orgasms can sometimes be so intense that you lose track of your personal narrative for a moment - though I'm no expert on experiencing torture, I'd wager that our capacities our comparable on the pleasure/pain scales.

The big difference between the two is duration - our pleasure centres naturally revert to boredom, while pain is unceasing. Perhaps a modification that made pain as brief as an orgasm, before subsiding into throbbing? Then you'd know that you just smacked your toe while running up the concrete steps, but you wouldn't be stuck rolling around on the floor for ten minutes afterwards.

Also, I'd suggest that trying to prevent torture isn't the same as modifying pain. Even if the torturers can't somehow re-modify you to experience pain (like that robot Vader used on Leia), they could find some other way to hurt you, emotionally (torture a puppy) or existentially (burn the last copy of Shakespeare).

I'd say the primary bad thing about pain is not that it hurts, but that it's pushy and won't tune out. You could learn to sleep in a ship's engine room, but a mere stubbed toe grabs and holds your attention. That, I think we could delete with impunity.

If we could learn to simply get along with any level of pain... how would it constitute an obstacle?

Real accomplishment requires real obstacles to avoid, remove, or transcend. Real obstacles require real consequences. And real consequences require pain.

Beyonder here. The "unbearable pain of broken hearts" sounds like an interesting experience. I'll take one of those, and one "defeated in a fist fight". The "Romeo and Juliet just seems less and less relevant" sounds interesting too, but I'll try that later.

Hrm... I'm pretty sure that, at least initially, losing the capacity for pain is a change I would not want. There're definite changes I would want in myself, but I don't think, at least initially, I would want that.

I'd want more to be, well, "stronger" than I am, better able to handle it, for lack of better terminology. Not so much less pain so much as so much more, well "me", that the pain can't fill it. (Yes, this is obviously imprecise. I'm simply trying to appeal to how I currently imagine the desired state "feeling from the inside", as best as I can.)

Further, in the long term, I'm thinking I may want to keep the capacity because I don't think I'd want to give up the ability to really properly "comprehend from the inside" my memories. So I think I'd want to retain some of that circuitry in some form, at least to decode ancient memories.

(But then, contrary to something you hinted at in a previous post, I think I would like, on some level, to still like cookies even by the time the last star would have burned out. I find the idea of carrying the ability to enjoy such a "simple childish" pleasure so far into deep time to itself be appealing. That and I hope to retain appreciation at least in some form for something analogous to corny puns. And again, for similar motivations.)

However, the similarity of removing pain to removing boredom or anything analogous, well... I'm not sure. I think one motivation I'd have would be more "increasing complexity/possibility of human experience", so it's partly I just don't want to give up a "trick" I already have.

But if pleasures came in complex forms like tastes and smells and... no. Cancel that. Let's go farther: Pleasure as complex as human vision (or, preferably, much farther. But you get the idea), then it might be different. I don't know if this is possible, it'd be a much longer term change, a more complex upgrade probably, but eventually setting myself up so that at no point do the pleasures translate to any simple one dimensional positive reinforcement. That "all the way down" the algorithm stack it's distinct and complex, and not just differently named tokens that do the same thing, then maybe we could more or less safely eliminate suffering without giving up anything important, without really approaching anything as, well, anything as downright depressing as a world of static blissed out wireheads.

I don't know if it's possible to really get something like pleasure that doesn't, somewhere in the stack of stuff that generates experience, translate on some level to simple 1D reinforcement. I admit this notion of being able to do this may be an incoherent confusion, I'm really unsure here. But I think if it was possible, getting rid of the whole simple 1D positive reinforcement thing might be nice, if on all levels of experience it was more complex than that.

Further, in the long term, I'm thinking I may want to keep the capacity because I don't think I'd want to give up the ability to really properly "comprehend from the inside" my memories. So I think I'd want to retain some of that circuitry in some form, at least to decode ancient memories.

Throwing away the circuitry behind tears means throwing away the circuitry that allows one to sympathize with the tears of others. To ignore the objection any virtue ethicist that might be reading this currently for a little while, obviously in a world without tears such sympathy may not be needed. But as you point out we still have our memories and great tales that we'd probably like to go on appreciating somewhat for a long time to come.