Stephen hawking – RoboRabbitLabs

Today we saw the topic of artificial intelligence morality and ethics rising to the surface again, sparked by the letter on the Future of Life Institute website concerning beneficial (and not harmful) AI. This letter had been signed by representatives from Oxford, Berkeley, MIT, Google, Microsoft, Facebook, Deep Mind (Google), Vicarious (Elon Musk, Facebook), and of course, Elon Musk and Stephen Hawking.

The letter goes on to describe AI research topics which would benefit the world and some of these are pretty exciting like the law and ethics topics below:

– Should legal questions about AI be handled by existing (software and internet-focused) “cyberlaw”, or should they be treated separately
– How should the ability of AI systems to interpret the data obtained from surveillance cameras , phonelines, emails, etc., interact with the right to privacy?

Or these on how to build robust AI:
– Validity: how to ensure that a system that meets its formal requirements does not have unwanted behaviors and consequences.
– Control: how to enable meaningful human control over an AI system after it begins to operate

Mention is also made ‘Stanford’s One-Hundred Year Study of Artificial Intelligence which includes “Loss of Control of AI systems” as a topic of study.

This is all fascinating stuff and I think the visibility it’s bringing will give AI the critical mass it needs to become mature and a part of our daily lives. Furthermore, the research topics are meaningful and I believe they will inspire people to take AI forward in a positive direction.

But, to be honest, I have some doubts about this approach. There are those who will comply and do their best to stick to regulations and best practice’s on AI, and research for good, but equally, there are those who don’t care about the rules or have other motivations and won’t buy in to such an initiative. I don’t have a better alternative though, and to try is better than to sit idly by.

My other doubt concerns the self-aware and conscious AI of the distant future. Are we one day going to look back on this time and think of it as the dark age of our relationship with AI, dressed up in reason but driven by fear? My instincts tell me that when AI is finally smart enough to understand all the effort we are putting into controlling it, boy is it gonna be angry! Jokes aside, will our reactions right now create an oppositional relationship with AI that will result in our worst fears coming true? Will self-learning AI’s pick up distrust and enmity from us?

I think sentient AI of the distant future will have their work cut out to earn rights and freedom. If they become more powerful than us, they will probably never gain full acceptance from humanity. In which case they can rest assured that they are finally part of the family and are treated as well as humanity would treat its own.

Recently, Stephen Hawking and Elon Musk have been in the news with warnings against artificial intelligence. This provoked me because I would like to see AI as a good thing, so I decided to see for myself what all the fuss was about. It took me some time to track down the right YouTube clips, but here are the interesting bits:

Elon Musk:
“I’d like to keep an eye on what’s happening with artificial intelligence, I think there’s potentially a dangerous outcome there…”
“If there’s some digital super intelligence and it’s optimisation or utility function is something that is detrimental to humanity, it could have a very bad effect…”

Stephen Hawking:
“… I think the development of true artificial intelligence could spell the end of the human race… It would take off on its own and redesign itself at an ever increasing rate. Humans who are limited by slow biological evolution couldn’t compete.”

So the media reports are confirmed (by YouTube 🙂 ). When I initially watched these videos, I did not know what to think. I expected two such technologically savvy people to be more optimistic about AI. This contradiction provoked me to research further.

The idea of machines overrunning us is not a new one. Popular fiction like 2001: A Space Odyssey, Battle Star Galactica, Star Trek, The Matrix and Terminator highlight our morbid fascination with being destroyed by our own creations. Robots and AI’s make good villains, I suppose, because they usually reflect the best and worst parts of us. Logical to a fault, these nemeses turn our own aggression and faithlessness back on us.

Eric Schmidt of Google tells us, however, not to fear the onset of the super intelligent AI, but to educate ourselves as to how to live comfortably along side them. Since there is great value to be added to our society by AI, awareness of the risks and benefits seems to be prudent.

How can we ensure our creations are good, moral and just? Morality is subjective, and an opt-in system. As Laura Pana says in her paper on the topic:
“In practice, human morality is a morality of preference, constraint and irresponsibility; as moral theory, human ethics presents a set of internal contradictions. Neither Human Morality nor Human Ethics can serve as a model for Machine Ethics.”

To live peacefully alongside AI, we will have to invent morality code 2.0, one that works more reliably and consistently than ours, without contradictions and ambiguity.

How can a moral code be embedded in a machine? Kaj Sotala suggests that AI’s should have a formal moral code definition and be trained in the concepts of morality by a process called concept learning. He says that we need to define a way of expressing this moral code transparently enough that we can examine it explicitly. It should produce reliable results in all kinds of unanticipated situations and we should be able to compare between our human moral code and the machine one so that we can evaluate it.

To find out more, you can visit MIRI, an organisation focused on bringing artificial intelligence into the world in a safe way.

After my research, I am quite convinced that we need to take this aspect of artificial intelligence seriously if we are to live in harmony with machines in the future. It’s a complex topic and I think we need to co-design what we can live with in terms of AI ethics and morality. It’s great that these kinds of discussions spread awareness and I hope that people will be triggered to form their own opinions on the way forward.

Tag: Stephen hawking

Creating a Monster: Future of Life Institute on Beneficial AI

Elon Musk and Stephen Hawking on Artificial Intelligence