‘EarEcho’ Uses Your Ear to Unlock Your Phone

The pervasiveness of people wearing in-ear headphones, especially on college campuses, intrigued computer scientist Zhanpeng Jin.

“We have so many students walking around with speakers in their ears. It led me to wonder what else we could do with them,” says Jin, an associate professor in the computer science and engineering department in the School of Engineering and Applied Sciences at the University at Buffalo.

A prototype of the new system, described in a paper in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, proved roughly 95% effective.

How does it work?

The team built the prototype with off-the-shelf products, including a pair of in-ear earphones and a tiny microphone. Researchers developed acoustic signal processing techniques to limit noise interference, and models to share information between the EarEcho’s components.

When a sound is played into someone’s ear, the sound propagates through and is reflected and absorbed by the ear canal—all of which produce a unique signature that the microphone can record.

“It doesn’t matter what the sound is, everyone’s ears are different and we can show that in the audio recording,” says Jin. “This uniqueness can lead to a new way of confirming the identity of the user, equivalent to fingerprinting.”

The information gathered by the microphone is sent by the earbuds’ Bluetooth connection to the smartphone where it is analyzed.

To test the device, 20 subjects listened to audio samples that included a variety of speech, music, and other content. The team conducted tests in different environmental settings (on the street, in a shopping mall, etc.) and with the subjects in different positions (sitting, standing, head tilted, etc.).

EarEcho proved roughly 95% effective when given 1 second to authenticate the subjects. The score improved to 97.5% when it continued to monitor the subject in 3 second windows.

Unlocking Your Phone with EarEcho

Theoretically, users could rely on EarEcho to unlock their smartphones, thereby reducing the need for passcodes, fingerprints, facial recognition, and other biometrics.

But Jin sees its greatest potential use in continuously monitoring a smartphone user. EarEcho, which works when users are listening to their earbuds, is a passive system, meaning users need not take any action, such as submitting a fingerprint or voice command, for it to work, he says.

Such a system, he argues, is ideal for situations where users are required to verify their identity such as making mobile payments. It also could eliminate the need to re-enter passcodes or fingerprints when a phone locks up after not being used.

“Think about that,” says Jin, “just by wearing the earphones, which many people already do, you wouldn’t have to do anything to unlock your phone.”

UB’s Technology Transfer office has filed a provisional patent application for the technology.

Additional coauthors of the study came from the University at Buffalo and Syracuse University.

This article was originally published in Futurity. It has been republished under the Attribution 4.0 International license.