“Stair mode” in NEO's RL controller engages stereo RGB vision to infer the height of the floor around it, combining this with proprioceptive history to anticipate each step's height and plan precise, stable foot placement.
1X announces their latest reinforcement learning (RL) controller, which unlocks NEO's full-body mobility for home environments, enabling Redwood AI (1X's in-house AI model) to interact with the physical world more naturally and broadly.
The unified controller supports walking in any direction, sitting, standing, kneeling, lying down, getting up, and climbing stairs using stereo RGB vision - critical for navigating real homes. The controller provides an “action interface” through which teleoperation or Redwood AI can interact in a safe, contact-rich manner with the physical world.
Traditional walking controllers often rely on hand-crafted "shaping rewards" to produce human-like gaits, which are time-consuming and don’t scale well across tasks or movement directions. To address this, the team used motion capture data to guide the learning process. The RL system is trained to track kinematic reference trajectories derived from natural human motion while maintaining balance and rhythm in real time.
To improve general-purpose utility, the controller goes beyond single-trajectory replay by introducing a two-part design:
⦿ A high-level kinematic planner generates smooth, human-like movement goals from simple input commands (e.g., joystick direction).
⦿ A low-level RL controller tracks these trajectories with dynamic stability.
This structure enables smooth transitions between behaviors and resolves the challenge of controlling high-dimensional motion from coarse user input.
646
53.27K
The content on this page is provided by third parties. Unless otherwise stated, OKX TR is not the author of the cited article(s) and does not claim any copyright in the materials. The content is provided for informational purposes only and does not represent the views of OKX TR. It is not intended to be an endorsement of any kind and should not be considered investment advice or a solicitation to buy or sell digital assets. To the extent generative AI is utilized to provide summaries or other information, such AI generated content may be inaccurate or inconsistent. Please read the linked article for more details and information. OKX TR is not responsible for content hosted on third party sites. Digital asset holdings, including stablecoins and NFTs, involve a high degree of risk and can fluctuate greatly. You should carefully consider whether trading or holding digital assets is suitable for you in light of your financial condition.