NEURA Robotics has introduced Neuron AI, its multimodal foundation model for Physical AI. Combining 3D vision, touch, audio, robot state and language with memory, Neuron AI enables robots to act on information beyond what cameras alone can capture, as well as retain relevant context when objects disappear from view. Its Perception-Language-Action (PLA) architecture connects what a robot sees, hears and feels with what it has already done, turning multisensory information into physical action.
“An intelligent robot needs a brain that brings its senses together and remembers what happened,” said David Reger, Founder and CEO of NEURA Robotics. “With Neuron AI, we are building the brain of the physical world: Physical AI that turns human expertise and physical experience into capabilities robots can learn and apply. Developed in Germany, built for the world.”
Cameras capture geometry, colour and position, but provide no information about contact, force or sound. Humans also rely on more than sight: they feel whether a screw has caught and hear when a connector clicks into place. Neuron AI applies this principle to robots. Rather than treating each sensor as a separate input, the model encodes 3D vision, tactile and force data, audio, robot state and language, aligns them in one shared space over time and turns them into a single stream of action.
Multisensory perception matters most for tasks that cameras cannot solve on their own. When a robot opens a lock, only sound and touch confirm that it is really open. With touch, a robot can grasp objects it cannot see. The additional senses also improve tasks that vision can already handle: in welding, for example, the quality of a seam can be judged from the sound of the process.
In addition, Neuron AI has a memory function. To act in the physical world, a robot needs a sense of cause and effect and object permanence, the ability to remember objects when they are out of sight, which humans acquire in their first two years of life. Unlike purely digital AI, a robot acts in a continuous physical world and must keep track of objects and the consequences of its own actions over time, often without seeing them. NEURA adapted the model’s architecture specifically to introduce memory and trains it on dedicated datasets that make use of it.
