Robot DE NIRO

Dual arm manipulation is quite interesting. Not sure if anyone else is interested in this.

Researches at London Imperial college have developed Robot DE NIRO. The abstract is as follows:

ROBOT DE NIRO is an autonomous, collaborative, humanoid robot for mobile manipulation. We built DE NIRO to perform a wide variety of manipulation behaviors, with a focus on pick-and-place tasks. DE NIRO is designed to be used in a domestic environment, especially in support of caregivers working with the elderly. Given this design focus, DE NIRO can interact naturally, reliably, and safely with humans, autonomously navigate through environments on command, intelligently retrieve or move target objects, and avoid collisions efficiently. We describe DE NIRO’s hardware and software, including an extensive vision sensor suite of 2D and 3D LIDARs, a depth camera, and a 360-degree camera rig; two types of custom grippers; and a custom-built exoskeleton called DE VITO. We demonstrate DE NIRO’s manipulation capabilities in three illustrative challenges: First, we have DE NIRO perform a fetch-an-object challenge. Next, we add more cognition to DE NIRO’s object recognition and grasping abilities, confronting it with small objects of unknown shape. Finally, we extend DE NIRO’s capabilities into dual-arm manipulation of larger objects. We put particular emphasis on the features that enable DE NIRO to interact safely and naturally with humans. Our contribution is in sharing how a humanoid robot with complex capabilities can be designed and built quickly with off the-shelf hardware and open-source software. Supplementary material including our code, a documentation, videos and the CAD models of several hardware parts are openly available available at https://www.imperial.ac.uk/robot-intelligence/software/

Full article is at http://kormushev.com/papers/Falck_Frontiers-2020.pdf