Understanding instead of just "seeing"
Chaotic storage is still considered a prime example for those too lazy to search. At the Technical University of Munich (TUM), a robot has now been developed whose primary task is to track down missing items. According to TUM, it's one of the first robotic companions that not only integrates image understanding but also meaningfully connects it.

a tracker with RFID, Wi-Fi, and a barcode to every conceivable object and item is clearly not the obvious solution here. Instead, the robot from Professor Angela Schoellig's TUM Learning Systems and Robotics Lab, which has a camera mounted on its top, combines information from the internet with a spatial map of its environment.
To find something, the robot has to look around and create a three-dimensional image of the room. The camera initially delivers two-dimensional images, but their pixels also contain depth information.
Pixels with depth information
This creates a three-dimensional image of the environment accurate to the centimeter, which is constantly updated. A laptop also provides the robot with information about which objects are visible in the image and what significance they have for humans.
"We taught the robot to understand its surroundings."
Photos: TUM
Based on internet information, the robot understands that a table or windowsill could be used to briefly set down a specific item, while a stovetop or sink would be unsuitable. "The language model incorporates the relationships between the objects, and we translate this information into the robot's language"explains Schoellig. Small two-digit numbers appear on the three-dimensional map of the environment, constantly recalculating the probability of the sought-after object being located there.
In a dynamic environment
The robot then searches the likely locations almost 30 percent more efficiently than if it searched randomly around the room, according to the research findings. Artificial intelligence is thus used in two ways: firstly in image recognition, and secondly through the use of a language model. A demonstration of the search robot was on display at the German Robotics Congress in Cologne until Friday.
https://robotics-insti...event/grc/
LI-NEWSLETTER
Every week, the latest logistics news from Switzerland, the EU and the rest of the world.
Subscribe now




























