The Invention of Mind Reading: Amputees Can Control a Robotic Arm With their Mind

Most commercial prosthetic limbs on the market can be controlled from the chest or shoulders using a wire-and-harness system. Advanced models use sensors to detect tiny muscle movements above the prosthetic. However, both options can be confusing for amputees and sometimes are unhelpful.

Cameron Slavens (University of Minnesota) shakes hands as Professor Zhi Yang, a University of Minnesota Department of Biomedical Engineering associate, discusses the robotic arm system and shares his thoughts with Zhi Yang. The researchers developed a method to tap into the brain signals of patients using a neural chip embedded in the arm. This allows the researchers to read the patient’s mind and opens the doors to less invasive brain surgery alternatives. Credit: University of Minnesota, Neuroelectronics Laboratory

With the support of industrial collaborators, the Department of Biomedical Engineering at The University of Minnesota has created a small implantable device that connects with the peripheral nerve of an individual’s arm. This technology can be used in conjunction with an artificial intelligence computer and a robotic arm to detect brain impulses and allow upper limb amputees the ability to move their arms with only their thoughts.

The most recent paper by the researchers was published in theĀ Journal of Neural Engineering. This peer-reviewed journal is dedicated to the interdisciplinarity of neural engineering.

Jules Anh Tuan Nguyen is a University of Minnesota Twin Cities graduate and postdoctoral researcher in biomedical engineering. He said, “It’s much more intuitive than any commercial systems out there.” “Unlike other prosthetic systems, amputees don’t think about moving their fingers when they want to. Because the system says so, they are trying to activate their arm muscles. These systems are complex and require practice and a lot of learning. Our technology interprets the nerve signal directly and can determine the patient’s intent. They only need to think about how they would move their finger if they wish to move it.

Nguyen, who has been involved in this research for approximately 10 years with Professor Zhi Yang at the University of Minnesota’s Department of Biomedical Engineering, was one of the main developers of the neural-chip technology.

The University of Minnesota researchers have created a neural chip that can interpret brain signals and allow upper limb amputees to control the robotic arm with their thoughts. This is in addition to an artificial intelligence computer. Credit: University of Minnesota, Neuroelectronics Laboratory

In 2012, Edward Keefer, the CEO of Nerves, Incorporated and a neuroscientist in the industry, approached Yang to discuss creating a nerve implant for amputees. They received funding from the U.S. Defense Advanced Research Projects Agency (DARPA) and have conducted numerous clinical trials with amputees.

Researchers also collaborated with the University of Minnesota Technology Commercialization Office to create Fasikl, a startup that aims to commercialize the technology. Fall is a play on “fascicle”, which refers to a group of nerve fibres.

Nguyen stated that “the fact that we can affect real people and one day improve the lives of patients is really important.” It’s great to be able to create new technologies. But if you do only experiments in a laboratory, it doesn’t directly affect anyone. We want to be involved in clinical trials at the University of Minnesota. Over the last three to four years, I have worked with many human patients. When I can help someone move their finger or do something they never thought possible, it can make me very emotional.

Artificial intelligence is a key component of the system’s success, using machine learning to interpret nerve signals.

Yang stated that artificial intelligence “has the incredible capability to help explain many relationships.” This technology allows us to record nerve data and human data accurately. The AI system can use that type of nerve data to fill in the gaps and figure out what’s happening. It’s huge to be able to combine AI and chip technology. It could help us answer many questions that we didn’t know how to answer before.

This technology is not only beneficial for amputees but also patients with neurological disorders or chronic pain. Yang envisions a future in which invasive brain surgery will not be necessary, and brain signals can be accessed via the peripheral nerve instead.

The implantable chip can also be used for purposes other than medicine.

The wires must pass through the skin to connect to the robot arm and exterior AI interface. However, the chip could be connected remotely to any computer. This would allow humans to control their own devices, such as their cars or smartphone, with their minds.

“Some of these are actually happening.” Yang stated that much research is shifting from the “fantasy” category to the scientific category. Yang said this technology was originally intended for amputees, but it could also be useful for everyone.