UC Berkeley researchers have created a new device that combines wearable biosensors with artificial intelligence software to help recognize what hand gesture a person intends to make based on electrical signal patterns in the forearm. The device paves the way for better prosthetic control and seamless interaction with electronic devices.
Story excerpts:
“Prosthetics are one important application of this technology, but besides that, it also offers a very intuitive way of communicating with computers.” said Ali Moin, who helped design the device as a doctoral student in UC Berkeley’s Department of Electrical Engineering and Computer Sciences. “Reading hand gestures is one way of improving human-computer interaction. And, while there are other ways of doing that, by, for instance, using cameras and computer vision, this is a good solution that also maintains an individual’s privacy.”
...
Moin is co-first author of a new paper describing the device, which appeared online Dec. 21, 2020 in the journal Nature Electronics.
...
Andy Zhou is co-first author of this paper. Other authors include Abbas Rahimi, Alisha Menon, George Alexandrov, Senam Tamakloe, Jonathan Ting, Natasha Yamamoto, Yasser Khan and Fred Burghardt of UC Berkeley; Simone Benatti of the University of Bologna; and Luca Benini of ETH Zürich and the University of Bologna.
...
“When Amazon or Apple creates their algorithms, they run a bunch of software in the cloud that creates the model, and then the model gets downloaded onto your device,” said Jan Rabaey, the Donald O. Pedersen Distinguished Professor of Electrical Engineering at UC Berkeley and senior author of the paper. “The problem is that then you’re stuck with that particular model. In our approach, we implemented a process where the learning is done on the device itself. And it is extremely quick: You only have to do it one time, and it starts doing the job. But if you do it more times, it can get better. So, it is continuously learning, which is how humans do it.”
...
While the device is not ready to be a commercial product yet, Rabaey said that it could likely get there with a few tweaks.
...
This work was supported, in part, by the CONIX Research Center, one of six centers in JUMP, a Semiconductor Research Corporation (SRC) program sponsored by the U.S. Department of Defense’s Defense Advanced Research Projects Agency (DARPA). The work is also based, in part, on research sponsored by the Air Force Research Laboratory under agreement number FA8650-15-2-5401, as conducted through the Flexible Hybrid Electronics Manufacturing Innovation Institute, NextFlex. Additional support was received from sponsors of the Berkeley Wireless Research Center; the National Science Foundation Graduate Research Fellowship, under grant number 1106400; the ETH Zurich Postdoctoral Fellowship program and the Marie Sklodowska-Curie Actions for People COFUND program.
...
For full story, visit: news.berkeley.edu/2020/12/21/...
Video courtesy Nature journals and the Rabaey Lab
news.berkeley.edu/
/ ucberkeley
/ ucberkeley
/ ucberkeleyofficial