āSO, WHY are you wearing Google Glass?ā I ask the man ahead of me in the coffee line at Ubicomp, a computing conference in Zurich, Switzerland. He responds enthusiastically that he is trying to work out how people with diabetes could use Glassās camera to recognise the nutritional value of the food they eat and use that to predict their glucose levels, helping them better cope with their condition.
The wearer is Subrai Pai of the Georgia Institute of Technology in Atlanta, and his idea is just one of many healthcare applications for Glass. The camera-packing wireless eyepiece is also helping people to live with some of the problems of paralysis, blindness and deafness. And surgeons are eyeing Glass as a tool for improving surgery and medical education.
āThe headset is helping people to live with some of the problems of paralysis, blindness and deafnessā
Advertisement
Last month, Christopher Kaeding, a surgeon at Ohio State University in Columbus, to repair a patientās anterior cruciate ligament. As he went through the procedure, colleagues across town were able to view the action from Kaedingās point of view ā by virtue of a Google Hangouts online forum ā and offer advice, while medical students in yet another location watched and learned.
āA surgeon can wear Glass while operating, allowing medical students to watch and learn remotelyā
Beyond the operating theatre, Glass could be useful to people with sensory impairments. A blind person preparing to cook and wondering whatās in a food tin could easily find out by taking a picture of the label and sending it, with a question, to crowd workers on Amazonās Mechanical Turk using a system developed by researchers at Carnegie Mellon University in Pittsburgh, Pennsylvania, and at the University of Maryland in Baltimore.
āBack comes a result in seconds saying āno, the can does not contain nutsā. Or āflip the box around, youāre looking at the wrong sideā,ā says Thad Starner, of Georgia Tech, who is Googleās technical lead for Glass. āThis technology also helps with things you just donāt even think about as a sighted person, like is there a rash on my babyās head?ā
Starner is also working with people with paralysis of all four limbs to see how Glass can help them. For instance, Glass makes a sound that is conducted through your cheekbone to signal the arrival of a text or email, which can be sent from your phone via Bluetooth or over Wi-Fi. A tilt of the userās head, or a wink, tells Glassās sensors to display the message. āThey can then respond by voice and their words are sent to Google servers, converted to text and transmitted as SMS faster than their friends can text,ā says Starner.
Starner tells of a quadriplegic woman who has been empowered by Glass to act as navigator and videographer on camping trips with friends ā using Glassās heads-up, turn-by-turn satnav and its built-in camera. āGlass is reducing some of the barriers to such participation,ā he says.
The aim of Paiās project is to let people with diabetes view all of their health data in a simple Glass visualisation. āThis could include data from insulin pumps, continuous glucose monitors, pedometers, heart-rate monitors and nutrition information from a food journal captured via Glassās camera,ā says Paiās colleague Nate Heintzman, who runs the project at the University of California, San Diego. He admits that the system is not yet ready to perform automated food-recognition but says that simply having data in one place will help users make better health decisions.
The benefits extend to more than just those who live with impairments. For parents learning to communicate with deaf children, Georgia Tech researcher Kim Xu has developed SmartSign, an app demonstrated by Starner at Ubicomp, that allows a childās hearing family to ask for the sign language of a particular word and have a short video āmicrolessonā on that subject streamed to the Glass screen.
Google is not saying when Glass will become an affordable consumer product, but when it does, a raft of health applications await it. Sensors that measure heart arrhythmias are already being built into clothing by researchers like Lucy Dunne, a smart-textiles designer at the University of Minnesota in St Paul. It is likely that Glass will connect with such sensors to record and display their data.
Despite the technical wizardry, the trickiest problem Google faces, says Dunne, is the same one that faces makers of all wearable technologies: making Glass into something that people actually want to wear. That will mean making Glass look a lot more attractive than its current uber-geeky look. āPeople want to look normal. So you have to innovate within subtle conformity restraints and aesthetics,ā she says. āFashion is hard.ā
The Glass 2.0 wish list
Google Glass has a mic and camera, plus sensors for motion, orientation, proximity and eye winks, but a few more gizmos would really up its game.
So says Bernard Kress of GoogleX, the lab in Mountain View, California, where Glass is being developed. Top of his wish list is adding a Kinect-style depth camera to allow Glass to recognise its wearerās gestures, such as finger clicks and hand waves, to activate functions like sharing pictures quickly online. But he says he is still waiting for depth cameras to miniaturise enough.
Meanwhile, Japanese mobile network NTT DoCoMo has developed a way that a Glass-type headset could capture your face for video calls. Using four tiny fisheye video-camera lenses aimed at a userās face from the headsetās edges, four distorted images of your face can be captured, corrected and stitched together to create a full-motion selfie to be transmitted with your voice.
Kai Kunze at Osaka Prefecture University in Japan hopes Glass 2.0 comes with a gaze-tracking sensor. He has created an algorithm that logs your reading habits by watching for eye-movement patterns that differ when reading comics, newspapers, fashion magazines, textbooks or novels. It tots up your intake and warns you if you read too much junk.
