A reference architecture for AI in the loop
USA
Thank you for reaching out to Sigma Software!
Please fill the form below. Our team will contact you shortly.
Sigma Software has offices in multiple locations in Europe, Northern America, Asia, and Latin America.
USA
Sweden
Germany
Canada
Israel
Singapore
UAE
Australia
Austria
Ukraine
Poland
Argentina
Brazil
Bulgaria
Colombia
Czech Republic
Mexico
Portugal
Romania
Uzbekistan
AI success in manufacturing depends on more than accurate predictions. In environments where quality, safety, and traceability shape daily operations, predictions need to become governed actions that fit existing production, maintenance, compliance, and approval routines. This article explains how Forward Deployed Engineering supports that transition. We’ll look at the missing execution layer between AI outputs and operational systems, and outline practical starting points for teams that want AI to improve performance without weakening control.
Manufacturing operations in regulated industries (Pharma, Semiconductors, Nuclear, Food and Beverage, Medical devices) are built on deterministic processes: controlled inputs, defined steps, predictable outputs. Every deviation is documented, every decision is auditable. This is not bureaucracy. It is what keeps products safe and operations repeatable.

AI is probabilistic. It surfaces patterns, scores anomalies, and suggests next-best actions. When teams bolt AI outputs directly onto deterministic workflows, operators do not trust outputs they cannot explain, systems cannot act on recommendations that have no defined execution path, and the AI ends up in a dashboard nobody opens.
This is where Forward Deployed Engineering matters. In regulated manufacturing, AI cannot be delivered as a detached model, API, or dashboard. It has to be engineered into the real operating environment: the plant floor, MES workflows, quality systems, approval paths, maintenance processes, and compliance constraints. Forward Deployed Engineering turns AI from a prediction capability into an operational capability.
When we work with manufacturing clients, we build toward a five-layer architecture. The power comes from how the layers connect.
1. Data sources
Sensors, machine logs, MES records, and business context form the raw input. Most AI failures in manufacturing happen because models saw clean data in development and messy operational reality in production. Getting this layer right is a business investment, not a technical checkbox.
2. Data platform: Bronze, Silver, Gold
A vendor-neutral lakehouse-style medallion architecture gives data a consistent quality progression: raw ingestion (Bronze), harmonized records (Silver), analytics-grade data (Gold). This is where the difference between a PoC and a production system gets decided, and clean architecture makes AI outputs auditable, which matters enormously in FDA-regulated or ISO-constrained environments.
3. ML scoring
ML models appl to the curated data for anomaly detection (catching signals before they become problems) and MES notes reasoning (turning unstructured operator observations into actionable intelligence). Models are not making decisions here; they are scoring and informing.
The handoff from ML scoring to workflow orchestration should be a compact, governed recommendation object: affected machine, risk score, confidence level, affected component, recommended action, intervention window, expected cost of delay, and required approval level. This contract is what turns probabilistic inference into deterministic execution.
4. Workflow and AI orchestration: the critical layer
This is the layer most teams skip. Deterministic execution means the workflow follows a defined, replayable path. Durable execution means the workflow survives delays, crashes, retries, human approvals, and long-running business processes. Manufacturing AI needs both.
AI outputs from ML scoring need to be acted on, but not every sensor event or model output should become a workflow. Temporal should start when the system crosses from analytics into operations: when an anomaly, risk score, or recommendation requires a business response. We use market-proven workflow orchestration engines (such as Temporal) with deterministic execution guarantees that allow Gen AI nodes to operate within defined boundaries. Those nodes handle specific tasks: preparing context, applying compensation logic, and managing human gates where operator approval is required. The workflow path remains controlled. Every step is logged. The AI augments the process without owning it.
As part of deterministic execution, you should not orchestrate every sensor event or every model call. It should start when the system crosses from analytics into operations: when an anomaly, risk score, or recommendation requires a business response. At that point, the orchestration engine turns the AI output into a durable workflow with retries, approvals, compensating actions, escalation paths, and audit history.
5. Operational systems
Outputs flow into inventory, scheduling, production planning, and notifications. AI value arrives here, in measurable operational outcomes: reduced downtime, fewer defects, faster response. The right metric is not model accuracy. It is an operational improvement.
For example, an ML model detects abnormal vibration and thermal drift on a filling line motor. The model does not stop the line. Instead, it emits a recommendation: inspect the motor within 24 hours. A workflow checks spare-part availability, routes the case to maintenance, requests supervisor approval if required, schedules the inspection window, notifies production planning, records the technician outcome, and feeds the result back to the data platform. The AI detected the risk; the deterministic workflow ensured the response happened correctly.
The same pattern applies across regulated environments, but the operational consequence differs by industry.
Pharma: an undetected batch deviation can delay a launch, trigger a regulatory audit, or cause a recall. Every alert and corrective action must be traceable. AI changes the speed of detection; deterministic orchestration ensures the response is always documented and compliant.
Semiconductors: a wafer goes through hundreds of steps. Equipment drift detectable at step 40 may not surface as yield loss until step 200. ML scoring on equipment signatures, routed into a workflow that triggers engineer review and schedules maintenance, closes that gap before it becomes a scrap event.
Medical devices: FDA 21 CFR Part 820 and ISO 13485 require full component and process traceability. The risk profile of a field recall makes the case for AI-augmented quality control just as strong as in pharma, with the same need for human gates before any corrective action is executed.
Nuclear: deterministic control is non-negotiable by definition, but AI for predictive maintenance on aging infrastructure and anomaly detection across dense sensor arrays is a growing operational need. The architecture described here – AI scoring inside a controlled execution layer – is precisely what makes AI acceptable in safety-critical environments.
Food and beverage at the regulated end – infant formula, clinical nutrition, nutraceuticals – operates under FDA FSMA and HACCP regimes. Batch genealogy, allergen controls, and supplier traceability all benefit from the same pattern: ML detection feeding into a workflow that cannot be skipped or informally resolved.
Three starting points consistently deliver early value and build confidence for the next phase:
The future of manufacturing AI is not autonomous black-box decision-making. It is AI-native execution: probabilistic intelligence embedded inside deterministic, durable workflows that people can trust, regulate, and improve. That is where Forward Deployed Engineering becomes essential – not just building models, but engineering AI into the operating fabric of the enterprise.
Our AI in Operations offering in regulated industries is built on this architecture. We start with data, identify the highest-impact workflows, and build execution layers that operators trust because they are controllable, auditable, and explainable.
This is part of Sigma Software’s AI Compass framework – a structured pathway to AI-native execution built around where your organization actually is today.
For over 17 years, Andrii has been working in Data Analytics and Data Engineering, 7 of which in Data Science. He actively shares his knowledge as a trainer in Sigma Software University and mentor in Sigma Group.
AI-native operations cannot be created by simply adding AI tools to existing workflows. They require changes to decision logic, controls, data flows, human revi...
Agentic AI systems are designed to combine three capabilities: access to private data, exposure to untrusted content, and the ability to communicate externally....
The shift from fee-for-service to value-based care changes the math for medical organizations. You only get paid when patients stay healthy and avoid unnecessar...
Would you like to view the site in German?
Switch to German