19 points

expand_less expand_more

A number of prestigious people from AI and other fields have signed the open letter, including Stuart Russell, Peter Norvig, Eric Horvitz, Ilya Sutskever, several DeepMind folks, Murray Shanahan, Erik Brynjolfsson, Margaret Boden, Martin Rees, Nick Bostrom, Elon Musk, Stephen Hawking, and others. I'd edit that into the OP.

Also, it's worth noting that the research priorities document cites a number of MIRI's papers.

See comment in full context

Research Priorities for Artificial Intelligence: An Open Letter

23 points

expand_less expand_more

Jan 11, 2015

The Future of Life Institute has published their document Research priorities for robust and beneficial artificial intelligence and written an open letter for people to sign indicating their support.

Success in the quest for artificial intelligence has the potential to bring unprecedented benefits to humanity, and it is therefore worthwhile to research how to maximize these benefits while avoiding potential pitfalls. This document gives numerous examples (which should by no means be construed as an exhaustive list) of such worthwhile research aimed at ensuring that AI remains robust and beneficial.

23 points

expand_less expand_more

Comments

sorted by

Highlighting new comments since Today at 8:08 AM

All comments loaded

19 points

expand_less expand_more

A number of prestigious people from AI and other fields have signed the open letter, including Stuart Russell, Peter Norvig, Eric Horvitz, Ilya Sutskever, several DeepMind folks, Murray Shanahan, Erik Brynjolfsson, Margaret Boden, Martin Rees, Nick Bostrom, Elon Musk, Stephen Hawking, and others. I'd edit that into the OP.

Also, it's worth noting that the research priorities document cites a number of MIRI's papers.

19 points

expand_less expand_more

11 points

expand_less expand_more

There is also a discussion of this happening on Hacker News here.

11 points

expand_less expand_more

6 points

expand_less expand_more

Is the idea to get as many people as possible to sign this? Or do we want to avoid the image of a giant LW puppy jumping up and down while barking loudly, when the matter finally starts getting attention from serious people?

6 points

expand_less expand_more

7 points

expand_less expand_more

After the first few pages of signatories, I recognize very few of the names, so my guess is that LW signers will just get drowned in the much larger population of people who support the basic content of the research priorities document, which means there's not much downside to lots of LWers signing the open letter.

7 points

expand_less expand_more

2 points

expand_less expand_more

I'm impressed they managed to get the Big Three of the Deep Learning movement (Geoffrey Hinton, Yann LeCun, and Yoshua Bengio). I remember at the 27th Canadian Conference on Artificial Intelligence 2014, I asked Professor Bengio what he thought of the ethics of machine learning, and he asked if I was a reporter. XD

2 points

expand_less expand_more

2 points

expand_less expand_more

This has appeared in the popular science page "I Fucking Love Science", followed by almost 20 million people on facebook. I think this is extremely good news. Despite the picture and its caption, the article seems to take the matter seriously.

2 points

expand_less expand_more

2 points

expand_less expand_more

So if an AI were created that had consciousness and sentience, like in the new Chappie movie. Would they advocate killing it?

2 points

expand_less expand_more

Stuart_Armstrong

3 points

expand_less expand_more

If the AI were superintelligent and would otherwise kill everyone else on Earth - yes. Otherwise, no. The difficult question is when the uncertainties are high and difficult to quantify.

3 points

expand_less expand_more

0 points

expand_less expand_more

I didn't see Ray Kurzwiels name on there. I guess he wants AI asap, and figures it's worth the risk.

0 points

expand_less expand_more

-3 points

expand_less expand_more

Cool blog post! The discussion topic is actually fruitful in favor of me and gives me new ideas. Keep sharing here! Please Visit Doctor Who Coat: http://www.fitjackets.com/products/New-Doctor-Who-Coat.html

-3 points

expand_less expand_more

-6 points

expand_less expand_more

The article sources are great with collection of updated information. Great guidance site! Amazon Bontonwear Fight Club Jacket:http://www.amazon.com/BontonWear-Fight-Synthetic-Leather-Jacket/dp/B00N8XNMFQ

-6 points

expand_less expand_more