LESSWRONG

I've put a preprint up on arXiv that this community might find relevant. It's an argument from over a year ago, so it may be dated. I haven'

For the sake of argument, let's consider an agent to be autonomous if:   - It has sensors and actuators (important for an agent) - It ha

Suppose you want to predict the behavior of an agent. I stand corrected. To make the prediction, as a predictor you need: - observation

To the extent that an agent is predictable, it must be: - observable, and - have a knowable internal structure The first implies tha

Thirty spokes share the wheel's hub; It is the center hole that makes it useful. Shape clay into a vessel; It is the space within that makes

I'm interested in thinking formally about AI risk. I believe that a proper mathematization of the problem is important to making intellectua

Thanks for all the helpful comments and discussion around this post about using logical depth as an objective function for a supercontroller

There is a lot of mainstream interest in machine ethics now. Here are some links to some popular articles on this topic. By Zeynep Tufecki

I attended Nick Bostrom's talk at UC Berkeley last Friday and got intrigued by these problems again. I wanted to pitch an idea here, with th

If I understand the Singularitarian argument espoused by many members of this community (eg. Muehlhauser and Salamon), it goes something lik