#Sim2Real technology

[aci25]

China’s humanoid robot turns into Kung-fu master after dazzling dance debut

Robots train in a virtual setting, learn human actions, then transfer skills to real robots using Sim2Real technology.

Unitree’s latest video shows its compact humanoid robot mastering kung-fu moves, including punches and roundhouse kicks, while maintaining balance. The Chinese company is in the process of constantly upgrading G1’s algorithm, enabling it to learn and perform virtually any movement. The most recent update seems to have expanded the humanoid’s balance capabilities and repertoire of movements.

In a video released last week, G1 showcased agility and balance, performing smooth dances, precise footwork, while being interrupted.

In January, Unitree showcased its G1 robot’s smooth walking and running system, demonstrating agility, stability, and precise control on inclines and uneven terrain.

Humanoid robot’s agile moves

In its most recent video, Unitree’s G1 humanoid performs amazing kung-fu movements with amazing balance, albeit it almost trips once. The new algorithm upgrade that powers these nimble movements improves the robot’s capacity to learn and carry out intricate tasks. The G1 exhibits remarkable coordination and flexibility with 23 degrees of freedom (DoF) and enhanced stability. Notwithstanding this demonstration of martial arts expertise, the film concludes with a warning that users should not alter the robot in any way that could endanger others or teach it actual combat techniques. Unitree claims that the G1 is made to handle difficult, filthy, and repetitive jobs in a variety of settings, including at homes, factories, and hospitals. It embodies Unitree’s concept of humanoid robots serving as useful work and life companions.

Training begins in a virtual setting using Nvidia’s Isaac Simulator, allowing the robots to learn complex behaviors before they physically exist. This method entails building a digital twin of the humanoid robot that uses motion capture and video data to observe human actions. These behaviors are exercised in the virtual environment through reinforcement learning. Through a procedure known as Sim2Real, which smoothly converts simulated actions into real-world applications, the acquired abilities are subsequently transmitted to the physical robot.

Open-source motion

To improve the natural movement of its humanoid robots, such as the H1, H1-2, and G1 models, Unitree Robotics has released an open-source full-body dataset. This information enhances the robots’ flexibility and coordination, allowing them to mimic human-like movements – like dancing. Captured using LAFAN1 motion capture technology, the dataset is fully compatible with Unitree’s main robot models and showcases lifelike movements in a newly released demonstration video. The dataset features a redirection algorithm that combines interactive mesh and inverse kinematics technology. By taking into account end posture restrictions, joint positions, and velocity limitations, this novel method maximizes the robots’ movements.

RECOMMENDED ARTICLES

Unitree hopes to enable researchers and enthusiasts to investigate novel uses for humanoid robots in diverse real-world contexts by making this dataset publicly accessible.

High-performance H1 and H1-2 models from Unitree are built for advanced capabilities; as of March 2024, the H1 held the Guinness World Record for sprinting at 7.38 mph (3.3 m/s). The G1 model, on the other hand, provides a more portable and reasonably priced choice for research and development.

According to the firm, it aims to promote exploration and creativity through this open-source project, expanding the possibilities for more dynamic, human-like interactions and pushing the limits of humanoid robotics.

Source: https://interestingengineering.com

[tastydregs]

Ambi deploying parcel sorting robots at OSM warehouses

Ambi Robotics is deploying its parcel-sorting robots at OSM Worldwide’s warehouses in the U.S. Based on the minimum four-year robots-as-a-service (RAAS) deal, the flagship AmbiSort A-Series system will be installed at OSM warehouses in Atlanta, Chicago, and Las Vegas.

The AmbiSort A-Series is a configurable robotic sorting system that uses machine learning to adapt to mixed parcels like polybags, flats and boxes into last-mile mailsacks. The systems are modular and configurable to accept parcels via rolling bin or the new conveyor-fed automated induction system.

AmbiSort is powered by AmbiOS, the company’s proprietary operating system that leverages simulation-to-reality (Sim2Real) artificial intelligence (AI). AmbiOS is based on The Dexterity Network (Dex-Net) project that was developed at UC Berkeley to automate the training of deep neural networks to improve a robot’s ability to grasp various items. Many of Dex-Net’s developers are now working at Ambi Robotics.

According to Ambi Robotics, AmbiSort systems are first designed and trained in simulation, which speeds up training 10,000x faster than teaching algorithms in the physical world.

“At OSM Worldwide, we are always looking for ways to improve our sorting and delivery operations, and we’re excited to partner with Ambi Robotics to empower our workforce with cutting-edge technology across our warehouses,” said James Kelley, president at OSM Worldwide. “With the AmbiSort A-Series systems, we can improve order accuracy and speed to our ecommerce customers while improving efficiency and safety for our warehouse employees amid rising parcel demand.”

Ambi Robotics’ AmbiSort parcel sortation system. | Credit: Ambi Robotics

Ambi Robotics raised a $32 million funding round in October 2022. The company has now raised about $67 million since it was founded in 2018. It closed a $26 million Series A in September 2021.

Ambi said it deployed an additional 60 robots to its U.S. customer base in under 60 days ahead of the 2022 peak holiday season. It said its robotic sorting systems are being used in more than 13 cities across the U.S. Pitney Bowes, a global shipping and mailing company, is another high-profile customer for Ambi. The company’s recently signed a $23 million expansion deal that would bring AmbiSort systems to additional warehouse locations.

Jeff Mahler, co-founder and CTO of Ambi Robotics, will be speaking at the Robotics Summit & Expo, which takes place May 10-11 in Boston. Mahler will be on the panel “Innovation in Robotic Grasping” to discuss emerging approaches to robotic manipulation, including the work being done at Ambi.

    The post Ambi deploying parcel sorting robots at OSM warehouses appeared first on The Robot Report.