UCSF brain implant lets paralysed patients speak and gesture through a mind-controlled avatar

University of California researchers have built a brain implant that lets people with paralysis speak and gesture at the same time through a mind-controlled virtual avatar, as reported in a new Nature Neuroscience paper on two participants.

The system reads the brain signals that would have driven speech and movement, then animates a virtual avatar in real time — restoring something beyond words: the timing and expression of natural communication.

For the two participants, the difference between typing answers and holding a ‘live’ conversation through the avatar was profound — a step closer to how they communicated before paralysis.

Brain–computer interfaces are racing forward on several fronts; this one stands out for treating speech and gesture as a single, synchronous act.