What's up with Arbital?

This post is for all the people who have been following Arbital's progress since 2015 via whispers, rumors, and clairvoyant divination. That is to say: we didn't do a very good job of communicating on our part. I hope this posts corrects some of that.

The top question on your mind is probably: "Man, I was promised that Arbital will solve X! Why hasn't it solved X already?" Where X could be intuitive explanations, online debate, all LessWrong problems, AGI, or just cancer. Well, we did try to solve the first two and it didn't work. Math explanations didn't work because we couldn't find enough people who would spend the time to write good math explanations. (That said, we did end up with some decent posts on abstract algebra. Thank you to everyone who contributed!) Debates didn't work because... well, it's a very complicated problem. There was also some disagreement within the team about the best approach, and we ended up moving too slowly.

So what now?

You are welcome to use Arbital in its current version. It's mostly stable, though a little slow sometimes. It has a few features some might find very helpful for their type of content. Eliezer is still writing AI Alignment content on it, and he heavily relies on the specific Arbital features, so it's pretty certain that the platform is not going away. In fact, if the venture fails completely, it's likely MIRI will adopt Arbital for their personal use.

I'm starting work on Arbital 2.0. It's going to be a (micro-)blogging platform. (If you are a serious blogger / Tumblr user, let me know; I'd love to ask you some questions!) I'm not trying to solve online debates, build LW 2.0, or cure cancer. It's just going to be a damn good blogging platform. If it goes well, then at some point I'd love to revisit the Arbital dream.

I'm happy to answer any and all questions in the comments.

Comments

sorted by
magical algorithm
Highlighting new comments since Today at 3:50 AM
Select new highlight date
Rendering 50/88 comments  show more

This is really sad. I'm sorry to hear things didn't work out, but I'm still left wondering why not.

I guess I was really hoping for a couple thousand+ word post-mortem, describing the history of the project, and which hypotheses you tested, with a thorough explanation of the results.

If you weren't getting enough math input, why do you think that throwing more people at the problem wouldn't generate better content? Just having a bunch of links to the most intuitive and elegant explanations, gathered in one place, would be a huge help to both readers and writers. Students trying to learn are already doing this through blind googling, so the marginal work to drop the links is low.

Pulling all the info together into a good explanation still requires one dedicated person, but perhaps that task can be broken down into chunks too. Like, once one version is written, translating it for non-mathy people should be relatively easy. Same for condensing things for mathy people.

But, why wouldn't adding more mathematicians mean a few would be good at and interested in writing new articles? Where did you do outreach? What did you do? There are entire communities, scattered across the web, who exist to try and learn and teach math. Have you tried partnering with any of them, or recruiting members?

If not, why do you think it won't work? Do you see promising alternative approaches, or are good explanations impossible even in principle?

Sorry for the flood of questions. I've just been waiting with baited breath for Arbital to stop pushing me away and start pulling people in. I even linked some people, but felt guilty about it for putting a strain on your overloaded servers before you were ready for the general public.

Yes, many students would benefit from a math explanation platform. But it was hard for us to find writers, and we weren't getting as much traction with them as we wanted. We reached out to some forums and to many individuals. That version of Arbital was also promoted by Eliezer on FB. When we switched away from math, it wasn't because we thought it was hopeless. We had a lot of ideas left to try out. But when it's not going well, you have to call it quits at some point, and so we did. There was also the consideration that if we built a platform for (math) explanations, it would be hard to eventually transition to a platform that solved debates (which always seemed like the more important part).

I think if someone wanted to give it a shot with another explanation platform and had a good strategy for getting writers, I'd feel pretty optimistic about their chance of success.

I feel sad that the project is gone before I even understood how it was supposed to work.

I was like: "I have absolutely no idea what this is supposed to be or to do, but smart people seem enthusiastic about it, so it's probably a smart thing, and maybe later when I have more time, I will examine it more closely."

Now, my question is... how much should I use this as an outside view for other activities of MIRI?

Don't use the outside view. Use your brain. If Arbital was confusing, but you didn't look closer at it, then you didn't use your brain. If MIRI seems confusing and you don't look closer at it, then you aren't using your brain. The whole concept of "smart people" whom you can trust with anything is just wrong. There are only niche experts.

My two cents: Arbital had very little to do with MIRI, aside from Arbital being Eliezer's idea. But this was definitely out of his realm of expertise. MIRI/AI stuff is not.

The fact that a startup pivots doesn't automatically mean that it's founders are bad at what they are doing. Most startups fail or pivot from the outside view.

how much should I use this as an outside view for other activities of MIRI?

I'm unsure whether you should think of it as a MIRI activity, but to the extent you should, then it seems like moderate evidence that MIRI will try many uncertain approaches, and be somewhat sensible about abandoning the ones that reach a dead end.

That sure was an expensive way to test demand for Arbital 1.0. Have you thought about cheaper ways to test demand for Arbital 2.0?

Debates didn't work because... well, it's a very complicated problem.

I'd love to hear about this in more detail. What have you learned about the problem? Do you know what good solutions would look like, but they're too hard or expensive to implement? Or have you learned that it isn't feasible?

Here is my person take on why it's complicated:

When you ask someone if they would like a debate platform and describe all the features and content it'll have, they go: "Hell yeah I'd love that!" And it took me a while to realize that what they are imagining is someone else writing all the content and doing all the heavy lifting. Then they would come along, read some of it, and may be leave a comment or two. And basically everyone is like that: they want it, but they are not willing to put in the work. And I don't blame them, because I'm not willing to put in the work (of writing) either. There are just a handful of people who are.

So the problem is definitely not on the technical side. It's a problem with the community / society in general. Except I'm hesitant to even call it a "problem," because that feels like calling gravity a "problem." This is just the way humans are. They want to do things they want to do.

It seems to me like you never really tried to seriously invite people to participate and write content. The fact that people had to follow Arbitals process through "whispers, rumors, and clairvoyant divination" gave the impression that it was more in a closed state than that it was inviting people to participate.

That's a very good point. When we were doing math explanations, we did reach out to a lot of people (just not via LW). When we were doing debates, we reached out to a few people, because we didn't quite know what shape we wanted to the debate to take. So we didn't need that many people. (It would be a bit silly to move a community from one platform to another that's basically the same.)

So, yes, there were multiple times where we thought that we should invite more people / throw open the doors. Some of those times we postponed it because we weren't ready; one of the other times we probably should have done it.

You can think of this post as an invitation to use the platform.

How about writing a "top 10 posts on Arbital" post for LW discussion? That way it's easier for people to see discussions to which they might want to contribute.

When we were doing debates, we reached out to a few people, because we didn't quite know what shape we wanted to the debate to take. So we didn't need that many people.

That's a valid strategy but if that's what you did, why do you think your experience proves that it's hard to get people to contribute to the discussion?

How about writing a "top 10 posts on Arbital" post for LW discussion? That way it's easier for people to see discussions to which they might want to contribute.

I think that's better done by people who are actively writing and want to invite commenters.

That's a valid strategy but if that's what you did, why do you think your experience proves that it's hard to get people to contribute to the discussion?

Because we reached out to people who were pretty excited about the platform and who were already spending a lot of their time blogging / doing discussions. I imagine if we reached out to people who are less excited / who write less, we would have gotten even less of a response.

I agree with Christian. Did Arbital ever even come out of closed beta? My impression was that it did not, and you still needed to be whitelisted to have the chance to contribute.

Yeah, I can imagine myself doing a similar mistake. For websites, both the engine and the content are important. A bad engine can ruin otherwise good content (just look at the damage done to LW but not being able to effectively moderate sockpuppets and karma assasinations), but if you don't have enough content, it does not matter what engine you have, people will not come there.

And the more options you want to provide for the reader, the more text needs to be written.

The start page also direct me to the latest discussions the way the reddit start page does. It's hard to actually find the discussions.

If I go to a discussion like https://arbital.com/p/requisites_for_personal_growth/, there's no text field in which I can leave my comment, like there's on reddit (and here) or blogs that have a comment sections. I can click the button "Propose comment" but that design suggests to me that commenting isn't supposed to be my default reaction.

It seems disingenuous to call this new project Arbital.

Arbital has vague positive affect from being an attempt to solve a big problem in a potentially really impactful way.

Yet Another Blogging Platform, without the special features envisioned originally, is not solving a big problem (or actually any problem), and has a maximum plausible impact of "makes you a bunch of money and you donate that somewhere". Re-using the name is a self-serving attempt to redirect the positive affect from the ambitious, failed, altruistic project to the mundane, new, purely-capitalistic project.

Why aren't you just admitting defeat and going on to build something different?

Well, what does it have in common with the already-existing thing called Arbital?

As a software engineer, it seems strange to me that Arbital is trying to be an encyclopedia, debate system, and blogging site at the same time. What made you decide to put those features together in one piece of software?

Eliezer said he wanted all of those features. (And he is using basically all of them.) But also we worked on it for 2 years, so a lot of features accumulated as we were trying different approaches.

Will this "Arbital 2.0" be an entirely unrelated microblogging platform, or are you simply re-branding Arbital 1.0 to focus on the microblogging features?

I'm thinking of it as a completely new, unrelated platform. Whether or not it will live at arbital.com and be called Arbital is not yet decided, though currently I'm leaning towards yes. (But if, for example, some people are using the old Arbital, then it would probably be easier for me to put the new platform under a different domain & name.)

Is there a description anywhere of the history of Arbital development?

Specifically I once heard a 4th-hand description of Arbital as "the Stacks Project, but for everything." It seemed to me at the time that a good step would be to 'simply' extend the Stacks project until it encompasses all of math[*]. I'd like to know which of Arbital's difficulties would still apply there.

We don't have Arbital history anywhere, although I guess there is the blog, which captures a fraction of it.

"The Stacks Project, but for everything" was a decent description for part of our first approach. However, it's relatively easy for people to answer questions: doesn't take much time and you get instant credit. It's much harder to get people to write wiki pages / explanations: it takes a long time and you don't get that much credit.

I see finding high-quality content producers was a problem; you reference math explanations specifically.

I notice that people are usually good at providing thorough and comprehensible explanations in only their chosen domains. That being said, people are interested in subjects beyond those they have mastered.

I wonder if it is possible to approach quality content producers with the question of what content they would like to passively consume, and then try and approach networks of content producers at once. For example: find a game theory explainer who wants to read about complex analysis; a complex analysis explainer who wants to read about music theory; a music theory explainer who wants to read about game theory.

Then you can approach all three at once with the premise that if they explain the thing they are good at, they will also be able to read the thing they want to be explained well to them, on the same platform. There's a similar trick being explored for networks of organ donations.

Also, was there any consideration given to the simple mechanism of paying people for quality explanations? I expect a reasonable core of value could be had for low cost.

I expect that micro-blogging will be an excellent combination with the arbital-style of voting on things. I especially think that you could get very good results from voting on per-post 'related links' submitted by users. Tumblr has reblogs for responding to things, but those naturally become mediated by viralness instead of internal coherence.

I can imagine a neural-activation-like effect coming out of that, where frequently co-active posts naturally rise to the top of each other's links and become threads or topics.

Are you planning anything like that?

Thank you for the summary of the state of Arbital!

It seems that while you haven't achieved your full goals, you have created a system that Eliezer is happy with, which is of non-zero value in itself (or, depending on what you think of MIRI, the AI alignment problem etc., of very large value).

It'd be interesting to work out why projects like Wikipedia and StackOveflow succeeded, while Arbital didn't, to such an extent. Unfortunately, I don't really have much of an idea how to answer my own question, so I'll be among those who want all the answers, but don't want to write them... (Too niche a target? Luck? Lack of openness to contributors???)

Finally — this is obviously a huge request considering the amount of work you must have put into Arbital — if you're not planning to re-use much of the existing code and if you don't think that it would harm the new "Arbital 2.0", would you consider open-sourcing the existing platform? (This is distinct from the content being under CC BY-SA, though kudos to whoever made that decision!)

It'd be interesting to work out why projects like Wikipedia and StackOveflow succeeded, while Arbital didn't, to such an extent.

I had some experience being involved in Citizendium which failed. To me it feels like the key difference is openness to contribution.

Both Wikipedia and StackOverflow make it easy for anybody to get involved.

Eric recently shared a link to a post he wrote on Arbital on Facebook. I could either answer on Facebook or an Arbital. Given that Arbital didn't gave me a text field in which I could write my comment it was easier to answer on facebook and that's what I did.

Arbital also might be too slow. It's a general pattern that page loading time matters a great deal and I'm not aware of any successful website that is that slow in 2017.

My guess for Wikipedia's success is that they were one of the first; and there was more of a sense of an online community back then. Also it's easier to create Wikipedia content than, say, a good explanation. StackOverflow succeeded because asking and answering questions is pretty easy, you get instant feedback, and they got community management right. (They solved exactly one problem well!) The founders were also really well known so it was easy for them to seed the platform.

I can't open-source the platform as long as I'm doing the for-profit venture, since the platforms are too similar. However, if at some point I have to stop, then I'll be happy to open source everything at that point.

What were some specific ideas you had for "solving debates"? I was hoping Arbital would take the debate around a given topic and organize it into a tree. You start with an assertion that branches into supporting and opposing arguments, then those branch into rebuttals, then those branch into counter-rebuttals, etc.

That's one approach we ruled out pretty much from the start because that kind of structure is hard to read and laborious to create and maintain. However that mechanic on the blog level makes sense and that's basically how debates work right now in the wild.

Our main approach was creating "claims". Blogs would reuse claims and the discussion around each claim. I'd say that part was actually moderately successful.

One idea we played around with but didn't get to implement was allowing comments to easily leverage double-crux structure.