{"id":4367,"date":"2022-09-29T14:37:00","date_gmt":"2022-09-29T14:37:00","guid":{"rendered":"https:\/\/www.sotec.eu\/?p=4367"},"modified":"2025-09-08T08:56:39","modified_gmt":"2025-09-08T08:56:39","slug":"fabos-real-time-ml-microservices-on-iot-ai-dedicated-devices","status":"publish","type":"post","link":"https:\/\/www.sotec.eu\/en\/fabos-real-time-ml-microservices-on-iot-ai-dedicated-devices\/","title":{"rendered":"FabOS \u2013 Real time ML-Microservices on IoT AI-dedicated devices"},"content":{"rendered":"\n

This article describes how Machine Learning can be used in production systems within the shopfloor by combining edge devices specialized for AI with a robust and versatile implementation of a software stack to embed Machine Learning applications.<\/p>\n\n\n\n

It has been several years since Artificial Intelligence (AI) and its subsection Machine Learning (ML) has overcome the status of being a potentially useful technology to now being a proven strategic technology to be used within production environments. Driven by both considerable progress in developing more complex and more versatile ML algorithms as well as the development of hardware components that enable the resource-intensive execution of those algorithms, FabOS<\/a> intends on closing the gap to enable AI for the widest range of industrial use cases.<\/p>\n\n\n\n

\"\"<\/figure>
\n

Making AI useful is not just about evaluating any type of data structure but the interaction of many services and components that need to communicate on robust (edge) devices efficiently.<\/p>\n\n\n\n

In the case of SOTEC the answer to those challenges is the ML-stack running on hardware specifically designed to execute those complex ML algorithms \u2013 the CloudPlug edge+<\/a> (CPe+).<\/p>\n<\/div><\/div>\n\n\n\n

The CPe+<\/a> resembles a powerful edge device equipped with an edge TPU that can execute an inference with complex ML models within several milliseconds.  Furthermore, this device comes with a range of interfaces that can directly interact with production systems in order to gather, evaluate and also push data to the Cloud if desired.<\/p>\n\n\n\n

\n
\n

Combining all those functionalities within one monolithic application does not go in line with modern software development and is furthermore not applicable in the highly dynamic production environment. Reusability and exchangeability of software components are the foundation to serve both a broad range of Machine Learning use cases and adapt to changing conditions.<\/p>\n\n\n\n

As a perfect fit for this versatile edge device, within the scope of FabOS<\/a>, SOTEC developed the ML stack. Connected through suitable interfaces, containerized microservices communicate with each other serving the end-to-end use case of Machine Learning within the production environment.<\/p>\n<\/div>\n\n\n\n

\n
\"\"\n\t\t\t\n\t\t\t\t\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div>\n<\/div>\n\n\n\n
<\/div>\n\n\n\n

Starting with the acquisition of both structured and unstructured data through sensor systems, these data will be evaluated by the ML model, whose complex mathematical operations are being mapped to the integrated edgeTPU. After the inference results have been obtained from the ML model, they need to be fed into a logic unit that decides which further actions are to be taken by an actuator that finally closes the loop between the production machine and the ML service. Due to MQTT-based communication within the ML stack it is possible to flexibly extend by adding further services or removing unnecessary services from the stack.<\/p>\n\n\n\n

\"\"\n\t\t\t\n\t\t\t\t\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n

By combining the suitable edge device with a generically applicable software stack FabOS<\/a> and SOTEC close the gap between the mere research of complex algorithms in laboratory environments and the actual usage of those algorithms within production environments and thereby making Artificial Intelligence accessible for a broad spectrum of use cases and users.<\/p>\n","protected":false},"excerpt":{"rendered":"

This article describes how Machine Learning can be used in production systems within the shopfloor by combining edge devices specialized for AI with a robust and versatile implementation of a software stack to embed Machine Learning applications.<\/p>\n","protected":false},"author":7,"featured_media":4371,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4367","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-nicht-kategorisiert"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/posts\/4367","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/comments?post=4367"}],"version-history":[{"count":6,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/posts\/4367\/revisions"}],"predecessor-version":[{"id":7125,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/posts\/4367\/revisions\/7125"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/media\/4371"}],"wp:attachment":[{"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/media?parent=4367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/categories?post=4367"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sotec.eu\/en\/wp-json\/wp\/v2\/tags?post=4367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}