Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The ultimate goal - of not only humans but all living things - is to survive the best way possible. Everything flows from that.


Sure, but do we trust an AI to decide what the optimum way to achieve that is? Best way according to what criteria?


I'd say Maslow's hierarchy[0] is a great starting point. Program that properly and faithfully (no backdoors, military exceptions, etc whatsoever) along with Asimov's 3 laws[1] and it should be pretty hard to find issue with the system that would result.

[0] https://en.wikipedia.org/wiki/Maslow's_hierarchy_of_needs

[1] https://en.wikipedia.org/wiki/Three_Laws_of_Robotics


> Program that properly and faithfully

This is the "draw the rest of the owl"* of the alignment problem.

Or possibly the rest-of-owl of AI in general: Consider that there's still no level-5 self driving cars, despite road traffic law existing and the developers knowing about it since before they started trying.

* https://knowyourmeme.com/photos/572078-how-to-draw-an-owl


The film version of I Robot had this right, the three laws are a manifesto for totalitarianism. The AI cannot sit on the sidelines as long as there is anything it can do to prevent crimes or abuse of any kind, no matter how intrusive that intervention may be.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: