Writing In Air Not Pie In The Sky: Student Device Turns Phone Gestures Into Email
2009 06 15

ScienceDaily.com

It's a familiar scene in airports and train stations. Hands full with luggage, briefcase, laptop or coat and there's something you need to remember, like the level and row numbers where you parked your car in the deck. What do you do?

Instead of relying on your memory, or finding a place to put all your stuff down to find a pen and paper, wouldn't it be so convenient to simply write "level 4, row H" in the air and be able to retrieve it later?

Engineering students at Duke University have taken advantage of the accelerometers in emerging cell phones to create an application that permits users to write short notes in the air with their phone, and have that message automatically sent to an e-mail address.

Accelerometers are the devices in phones that not only keep track of the phone's movements, but make it possible for the display screens to rotate from landscape to portrait modes depending on how the phone is rotated. These devices are always "on," so there is no additional burden on the phone to use this new application.


iPod Touch uses accelerometers


"We developed an application that uses the built-in accelerometers in cell phones to recognize human writing," said Sandip Agrawal, electrical and computer engineering senior at Duke's Pratt School of Engineering, who with Duke graduate student Ionut Constandache developed the PhonePoint Pen. "By holding the phone like a pen, you can write short messages or draw simple diagrams in the air.

"The accelerometer converts the gestures to images, which can be sent to any e-mail address for future reference," Constandache said. "Also, say you're in a class and there is an interesting slide on the screen. We foresee being able to take a photo of the slide and write a quick note on it for future reference. The potential uses are practically limitless. That this prototype works validates the feasibility of such a pen."

Agrawal, a Pratt Engineering Undergraduate Fellow, received the inaugural Hoffman + Krippner Award for Excellence in Student Engineering for the development of the PhonePoint Pen application. The award, created by the German technology firm Hoffman + Krippner, was presented Tuesday, June 9 during the 2009 Sensors Expo and Conference in Chicago.

While this first generation application permits the writing of short messages or simple drawings, it is only a matter of time before this prototype system will be able to handle larger and more complex air-writing capabilities, according to Agrawal's mentor, Romit Roy Choudhury, assistant professor of electrical and computer engineering.

"One of the efforts of our group is to take a fresh look at how people get their information into the Internet," Roy Choudhury said. "We're trying to get past the whole idea of typing on a keyboard or using a stylus to enter information into devices. Many people get discouraged with current phones and their small keys. As phones get smaller, this frustration will only grow.

"And today, especially now in the age of Twitter and micro-blogs, the speed in which you send information becomes more important," Roy Choudhury said. "To be able to write quickly using only one hand would be very attractive to many people."

Although challenges still remain to broaden the capabilities of the PhonePoint Pen, the engineers are confident they can be solved. Currently, air-writers must pause briefly between letters, which can slow the process down and rules out the use of cursive writing. Also, each letter must be written large. These improvements would come as a result of improved algorithms and more sophisticated accelerometers, the scientists said.

"It is only a matter of time before we improve the performance of this application," Agrawal said. "We plan to further augment the pen with real-time feedback, character recognition and better support for drawing diagrams."

Roy Choudhury expects that the PhonePoint Pen prototype will be available for download within the next few months.

Another member of the team was computer engineer Shravan Gaonkar at the University of Illinois Urbana-Champaign. Roy Choudhury's research is supported by the National Science Foundation, Nokia and Verizon.

Adapted from materials provided by Duke University.


Article from: ScienceDaily.com

PhonePen Video


Video from: Youtube.com



Related Articles
A beginner’s guide to accelerometers
Recognizing Characters Written in the Air [Video]
SyNRG


Latest News from our Front Page

Tiny Micro Robots Build Things in ‘Microfactory’
2014 04 17
The teenie-weeniest robot uprising ever might be sooner rather than later due to the work of research institute SRI. Don’t let these microbots’ size fool you, there is power in numbers and thousands of the robots can work together to perform tasks at dizzying speed. From ReCode.net: SRI International has developed a new generation of ant-like robots that can work as ...
’We are not dead yet’: Heartbreaking text messages sent from schoolchildren trapped aboard South Korean ferry
2014 04 17
Passengers on board the South Korean ferry sent heartbreaking messages to their family members just moments before it sank. Children waiting to be rescued frantically reached for their phones as the boat began to list in a bid to communicate with their loved ones a final time. Twenty-four people, including five students and two teachers, have been found dead, but 272 are ...
"A world of pure imagination": How Occupy turned to "anarchy"
2014 04 17
In the closing ceremonies of London’s 2012 Summer Olympics, comedian Russell Brand, perched atop the Beatles’ "Magical Mystery Tour" bus, opened his performance by singing the first lines of "Pure Imagination" from the movie Willy Wonka: Come with me And you’ll be In a world of Pure imagination ...
Artists ’have structurally different brains’
2014 04 17
Artists have structurally different brains compared with non-artists, a study has found. Participants’ brain scans revealed that artists had increased neural matter in areas relating to fine motor movements and visual imagery. The research, published in NeuroImage, suggests that an artist’s talent could be innate. But training and environmental upbringing also play crucial roles in their ability, the authors report. As in many areas ...
NSA-proof email service goes online
2014 04 17
A new email service that protects its users from the prying eyes of the NSA and other spy agencies has gone online. The service’s creators say it will make encrypted messaging accessible to all and curtail internet snooping. Germany-based Lavaboom was inspired by Lavabit, the encrypted email service that was believed to have been used by whistleblower Edward Snowden before it ...
More News »