{"id":3489,"date":"2024-05-03T15:03:00","date_gmt":"2024-05-03T15:03:00","guid":{"rendered":"https:\/\/www.sotec.eu\/?p=3489"},"modified":"2025-09-08T08:13:16","modified_gmt":"2025-09-08T08:13:16","slug":"the-power-of-ai-and-natural-language-at-hannover-messe-2024","status":"publish","type":"post","link":"https:\/\/www.sotec.eu\/en\/the-power-of-ai-and-natural-language-at-hannover-messe-2024\/","title":{"rendered":"The Power of AI and Natural Language at Hannover Messe 2024"},"content":{"rendered":"\n

Hannover Messe 2024<\/a> was a resounding success! As a Google Partner, SOTEC was honored to showcase our cutting-edge technology at the Google Booth. We were excited to demonstrate how easy and intuitive it can be to control complex robotic systems using the power of natural language and Google\u2019s Gemini language model.<\/p>\n\n\n\n

Our demonstrator captivated audiences. Here\u2019s how it works:<\/p>\n\n\n\n

<\/div>\n\n\n\n

1. User Input:<\/h4>\n\n\n\n

In a web-based UI, visitors would type a command in plain English, describing the task they wanted the robot to perform.<\/p>\n\n\n\n

Examples:<\/h5>\n\n\n\n
    \n
  • \u201cStack all red objects.\u201d<\/li>\n\n\n\n
  • \u201cArrange the squares in a line.\u201d<\/li>\n\n\n\n
  • \u201cBuild me a snowman.\u201d<\/li>\n\n\n\n
  • \u201cMake me a cappuccino\u201d<\/li>\n<\/ul>\n\n\n\n
    <\/div>\n\n\n\n

    2. Object Detection:<\/h4>\n\n\n\n

    A built-in camera captures an image of a workspace containing various shapes (squares, circles, triangles) in different colors (green, blue, red, etc.). Powerful object detection AI identified and located each item.<\/p>\n\n\n\n

    <\/div>\n\n\n\n

    3. Gemini\u2019s Magic:<\/h4>\n\n\n\n

    This data \u2013 the object details and the user\u2019s natural-language instruction \u2013 was sent to Google Gemini. Gemini\u2019s astonishing capabilities allowed it to break down the task into logical steps and formulate a solution strategy for the robot, just using the available pieces. Even further, Gemini could easily be advised to provide the solution in a specific format (JSON).<\/p>\n\n\n\n

    <\/div>\n\n\n\n

    4. Robot in Action:<\/h4>\n\n\n\n

    Using that strategy provided by Gemini we could transfer it into precise commands the robot could execute, completing the visitor\u2019s request. The results could either be visualized in 2D or 3D.<\/p>\n\n\n\n

    \n