
A robot that tricks its opponent in a game of hide and seek is a step towards machines that can intuit our thoughts, intentions and feelings
ROVIO the robotic car is creating a decoy. It trundles forward and knocks over a marker pen stood on its end. The pen is positioned along the path to a hiding place – but Rovio doesn’t hide there. It sneaks away and conceals itself elsewhere.
When a second Rovio arrives, it sees the felled pen and assumes that its prey must have passed this way. It rolls onwards, but is soon disappointed.
Advertisement
The behaviour of the deceptive Rovio represents something much more significant than a crude game of robot hide-and-seek. It is a demonstration of an aspect of social intelligence known as theory of mind, which humans only develop around the age of 4 or 5. If robots can be made to display theory of mind in other situations, it could endow them with a sophisticated intelligence. They might then be able to reason the thoughts, intentions and even feelings of people and other robots.
“It was definitely exciting to see it work,†says of the Georgia Institute of Technology in Atlanta, who programmed Rovio with colleague Ron Arkin. “We have expanded the boundary of understanding deception and how deception relates to artificial systems.â€
The defining feature of theory of mind is the ability to model the beliefs and intentions of others as distinct to one’s own. Robots have previously hinted at this ability by performing a variety of mental tricks (see “Becoming awareâ€).
Deception, though, is definite progress. It requires not only the modelling of a distinct mind but also the ability to anticipate and manipulate the actions of others. “A deceiving agent knows what the other agent knows and intends to change what the other agent knows,†says , a cognitive scientist at the Massachusetts Institute of Technology.
To demonstrate artificial deception, Wagner and Arkin recruited two , made by WowWee in Hong Kong, for a game of hide-and-seek. Before the game, the robots were released to learn about the game environment and the effect of their own actions on it.
The environment featured three adjacent hiding places. On the path leading towards each of these hidey-holes, the researchers placed a marker pen stood on its end (see diagram).
Programmed to learn, the first thing seeker Rovio did was move into one of the caches, knocking the pen over on its way. The pen was reset and the robot repeated the process, 10 times in all. Using a combination of its camera and probabilistic software, it learned to associate fallen pen and hiding place.
Hider Rovio came to the same conclusions as it explored the environment, but crucially, it had been given the ability to learn how to send a false signal.
The game then began. Hider Rovio’s learned knowledge allowed it to predict what seeker Rovio would do in the same situation. It calculated that knocking over a pen and sneaking elsewhere would fool its seeker. “It uses its own model of itself to determine how best to deceive the other individual,†says Wagner.
In 15 of the 20 times the game was played, the seeker chose the wrong corridor (International Journal of Social Robotics, ).
However, many researchers point out that it is unsurprising that the deceiving robot should succeed, given the extent of its pre-programming. “It seems to me the theory of mind is in the experimenter, not the robot,†says , a roboticist and evolutionary biologist at Harvard University. “It’s like it’s staged; [the robot] is like a puppet rather than a child.â€
In 2009, Mitri was part of a team at the Swiss Federal Institute of Technology in Lausanne (EPFL) which created basic robots that evolved the ability to discourage other robots from accessing a common, finite “food†source, without being programmed to do so ().
Wagner acknowledges that the robots are pre-programmed, but emphasises that each one learns on its own. “It would learn how its movement affected the markers, which told it basically how to deceive,†he says.
, who researches machine consciousness at the Carlos III University of Madrid in Spain, agrees. “It is actually an implementation of theory of mind, because it is using the learning mechanism to update the model of the [opponent] or its own model.†He notes, however, that the robot can’t transfer the knowledge autonomously to another situation. “It is not like a human, it is something in between,†he says.
Humans have a generalised concept of deception, which wasn’t demonstrated by these robots. “It was implemented on a very specific task, for a very particular interaction,†says , an AI researcher at the Rochester Institute of Technology in New York state. “It’s a far cry from human theory of mind because it is so specific to the task.â€
Yet Gold acknowledges that it is a step in the right direction. “It provides a kind of outline for things that would be fleshed out in a more general system,†he says. “There is real stuff under the hood going on here.â€
Already, Wagner and Arkin have implemented a more complicated version of the hide-and-seek game in a software-only simulation. In this version, the software deceiver can tailor how it deceives its opponent depending on what particular sensors it discovers its opponent has – some have audio, others vision, others infrared. This extends the degree to which the deceiver reasons about its opponent’s abilities.
By introducing games where cooperation brings benefits or penalties, the deceiver can also be programmed to decide whether or not it is worthwhile to fool its opponent, by judging what kind of task it is.
Wagner hopes to develop the deception software to help robots become more human-like in their interactions with us, for example, by enhancing a machine’s ability to reason about a person’s likes, dislikes or other emotions. “It’s a springboard to reasoning about all kinds of other things,†he says. “We want a robot that could interact with people in any kind of situation.â€
“Using deception is a springboard to robots reasoning about all kinds of other thingsâ€
Could such a robot ever make moral decisions? “I think moral judgement is reserved for conscious agents,†says Young. “However, if robots are able to compute intentions, actions and outcomes, then in a sense robots may be able to deliver the moral judgements of others.â€
Exploring robot theory of mind in these ways could even tell us something about ourselves, Young says. “Any computational code that supports the external behavioural properties of theory of mind and deception can help us understand what’s going on in the human mind.â€
Becoming aware
Robots have passed various milestones on the road to true theory of mind
Mirror self-recognition
Recognising that the reflection in a mirror is your own is the ultimate mark of self-awareness, and in humans requires theory of mind.
In 2007, Kevin Gold, now at Rochester Institute of Technology in New York state, and Brian Scasselatti of Yale University reported that their humanoid robot, Nico, – by tracking its movements in the mirror.
The researchers emphasise the difference between Nico and human mirror-gazers. “This robot did self-recognition and nothing else,†says Gold. A human, by contrast, has a “rich world†of contextual information through which they interpret an image of themselves.
False belief
This sign of theory of mind requires someone to realise that another’s beliefs differ from their own. Children tend to master it at age 4 or 5.
To test it in humans, the subject is shown a scene in which person A puts an object in a drawer and leaves the room. Person B then moves the object. When person A returns, young children predict that they will look for the object in the new hiding place, despite the fact that person A would be unaware of the move.
Not so Leonardo, a robot created by Cynthia Breazeal and colleagues at the Massachusetts Institute of Technology. It uses face recognition to assign specific knowledge to individuals.
Follow my gaze
“Joint attention†is the tendency to both guide and follow someone else’s gaze. It is considered necessary for complex social interactions, deducing other people’s mental states and the learning of language and cooperation.
, a robot with a head, highly expressive face and arms at the Naval Research Laboratory in Washington DC, can do at least the first part of this task. follow a caregiver’s gaze as it shifts between two objects.
Greg Trafton and his colleagues at NRL hope to use Octavia to simulate the experiences of young children to help figure out how gaze-following emerges in humans.