Collection of 5G RHM Demos


Here the recorded demonstrations of 5G Research Hub Munich is displayed. A new video will be uploaded whenever a new state in the project is achieved and recorded.

NMPC-MP: Real-time Nonlinear Model Predictive Control for Safe Motion Planning in Manipulator Teleoperation

12.02.2021, TUM, Germany

Motion control and planning for the manipulator are critical components in manipulator teleoperation. Online (real-time) motion control is challenging for active obstacle avoidance and often results in fluctuating and unsafe motion. Offline motion planning, on the other hand, generates precise and secure trajectories for complex manipulation. In this paper, a real-time nonlinear model predictive control based motion planner (NMPC-MP) is designed for teleoperated manipulation. In contrast to traditional NMPC-based approaches, our model considers a complex environment with dynamic obstacles. Our multi-threaded NMPC-MP allows for real-time planning, including dynamic objects. We evaluate our approach both in a simulated environment and with real-world experiments using the Kinova ® Movo platform. The comparison to state-of-the-art approaches (e.g., RRT-Connect, CHOMP, and STOMP) shows a significant improvement in real-time motion planning using NMPC-MP. In real-world tests, the proposed planner was applied on a human-shaped dual manipulator setup. Our results show that the NMPC-MP runs in real-time and generates smooth and reliable trajectories. The experiments validate that the planner is able to precisely track active goals from the teleoperator while avoiding self-collision and obstacles.

End-to-End Connection with New Features of 2020

28.11.2020, TUM, Germany

In the video below end-to-end connection of our robot MOVO to 7-DoF Haptic Interface is demonstrated. The 5G Research Hub Munich presents the new features (autonomous navigation and dynamic path planning, Cloud-RAN and function split, data plane isolation) in our end-to-end system in this video. Further, the LMT vision system is integrated to the robot which is streaming over 5G to head mounted display for teleoperation.

End-to-End Connection with Haptic Interface

18.02.2020, TUM, Germany

In the video below end-to-end connection of our new robot MOVO to 7-DoF Haptic Interface is demonstrated over our network model. Commands are sent through Telepresence Station, where haptic interface is located and controlled via teleoperator, to the Radio Access Network which communicates with the MOVO robot via wireless channel with USRPs. The setup diagram of this demonstration is also provided within the video.

First Remote Control

18.06.2019, TUM, Germany

In the video below the very first wireless control of the MAVI robot is performed over our network model. Commands are sent through the Core Network to the Radio Access Network which communicates with the robot via wireless channel with USRPs. It is demonstrated in this video that we are able to control the movement of the robot and the gripper with our approach.

Merry Christmas

19.12.2019, TUM, Germany

Our 5G enabled robots wish you Merry Christmas and a Happy New Year! (If the video is not displayed click here.)

To be continued...

Acknowledgements

This work receives funding by the Bavarian Ministry of Economic Affairs, Regional Development and Energy as part of the project 5G Testbed Bayern mit Schwerpunktanwendung "eHealth".