EbV-Hand

Event-based vision for robot hands

01/03/2025 to 30/09/2025

Event cameras are a new generation of cameras that do not provide individual images (frames), but a continuous stream of all those pixels that have exceeded a threshold value compared to the previous value (events). These cameras are suitable for attachment to a robot hand because they can then very quickly recognise the relative position to the object when it moves towards an object and the robot can be controlled accordingly, even with moving objects. In the InSightCobot project (InvestBW Innovation II), a 3D-printed 2-finger gripper with a special sense of touch was developed. In the practical sprint, such a gripper is to be supplemented with an event-based camera close to the wrist so that the gripper can use this camera to optimally control the hand for gripping. This should also work for moving objects. We would like to use this to develop the next generation of robots in joint projects with robotics companies from Baden-Württemberg, such as Neura Robotics, Festo, Schunck, Weiss Robotics and others.