Canvas 5 — Model Lifecycle Management (MLOps) & Governance

How to use this canvas

This canvas covers how models for heavy-industry physical AI (construction, mining and earth-moving autonomy) are tracked, approved, shipped to machines, watched and retired, and how the governance around them works. It is the system of record that ties canvases 1–4 and 7 together. It is canvas 5 of 9 and follows a research-area exploration framework, with the Emerging (11–12) and Applied (13) modules added. Claims about the future are labeled as such; numbers carry a source or are marked as estimates.

BoundaryOwned hereOwned elsewhere
LineageModel lineage: run → checkpoint → registered version → deployed artifactDataset lineage (canvas 1); joining both in the reference architecture (canvas 9)
EvaluationRecording gate results and enforcing "no promotion without a pass"Designing and running the gates (canvas 4)
DeploymentRelease workflow, OTA delivery to machines, staged rollout, rollbackOptimizing and serving the model (canvas 7)
MonitoringModel-quality monitoring: drift, performance, field feedbackPlatform observability, SLOs and cost (canvas 8)
GovernanceModel inventory, risk tiers, approvals, documentation, auditSafety case content (canvas 4); legal interpretation (qualified counsel)

1. Core definition and scope

Definition. Model lifecycle management (MLOps) is the set of practices and systems that carry a model from a training run to a governed, deployed and monitored asset, and finally to retirement. Governance adds the rules on top: who may approve, what must be documented, what is audited. A model registry is the core: each registered version links back to the run, data and code that produced it (MLflow).

Physical AI changes the deployment end. Models ship over the air (OTA) to machines with intermittent connectivity, inside packages that must be signed, verified, installed atomically and rolled back if needed (Promwad).

Model lifecycle from run to retirement
model lifecycle · 8 stages, 7 owned here

The top row decides whether a model may ship; the bottom row ships it to machines, watches it and takes it back when needed. Every stage writes to the same lineage and audit trail.

Key sub-domains

Sub-domainCore questionTypical artifacts
Experiment trackingWhat exactly happened in each run?Run records: code commit, container, data version, config, metrics
Model registryWhich versions exist, and what state is each in?Registered versions; stages or aliases (candidate, approved, deployed, retired)
Model lineageCan a deployed model be traced to its data and code?Lineage graph from dataset to machine
Release workflowWho approves, based on what evidence?Approval records, gate results (canvas 4), change tickets
Packaging and signingIs the artifact on the machine the one that was approved?Signed packages, SBOMs, model BOMs, hashes
Fleet deployment (OTA)How do models reach machines safely?Cohorts, canary plans, dual-slot installs, rollback
Model monitoringIs the model still performing in the field?Drift metrics, field KPIs, intervention rates
Governance and inventoryWhich AI systems are in operation, at what risk tier, under which rules?AI inventory, risk classification, model cards, audits
RetirementWhen and how is a model removed?Deprecation plans, archive policy

Debate. Buy a unified platform (e.g. Databricks with Unity Catalog) or assemble open components (MLflow, Kubeflow, Argo, a lineage service)? Unified platforms give governance quickly; assembled stacks avoid lock-in and may fit edge deployment better. Hybrid setups are common in industrial settings (author's observation, not a measured share).

2. Historical context and evolution

MLOps grew from the discovery that ML systems accrue hidden debt, through a wave of platforms, to today's mix of registry-centered governance and fleet-scale edge deployment.

YearMilestoneWhy it matters here
2026EU Digital Omnibus on AI (Regulation (EU) 2026/1744) in force 27 July: machinery removed from the AI Act's direct high-risk regimeAI requirements for machinery are expected to come through the Machinery Regulation instead
2026Edge MLOps tooling matures: atomic OTA with rollback and cohort targeting for Jetson (Edge AI and Vision Alliance); Red Hat FlightCtl for edge GPU fleetsFleet deployment becomes a product category
2026A mining OEM reports commissioning its 1,000th autonomous ultra-class haul truck and describes a software-defined vehicle strategy in which machines improve over the life of the asset (Komatsu; company statement)Autonomy fleets at this scale make software lifecycle a core operating concern
2025MLflow 3: logged models and deployment jobs, governed by Unity Catalog (Databricks)Registry becomes the hub for lineage and approvals
2023ISO/IEC 42001 (AI management systems); NIST AI RMF 1.0First certifiable AI governance standard
2022–2024LLMOps; EU AI Act adopted (2024)Governance of foundation models; legal duties for AI
2019Model Cards (Mitchell et al.); Datasheets for DatasetsStandard model documentation
2018–2020MLflow (2018), Kubeflow, TFX, SageMaker; feature storesFirst MLOps platforms
2015Sculley et al., Hidden Technical Debt in ML SystemsML systems need engineering discipline beyond the model
2021UNECE R156 software-update management rules for road vehicles, in force from 22 January 2021 (EUR-Lex)Regulated, signed software updates to vehicles; reference practice for machinery

Paradigm shifts

  1. From model files to registered, governed assets. Every version has an owner, lineage and approval state.

  2. From cloud endpoints to fleets. For physical AI, "deploy" means a staged OTA rollout to machines, not an API swap. An industry blog reports that Waymo runs weekly model updates with staged canary cohorts (Metavert; secondary source).

  3. From voluntary to regulated governance. AI inventories, risk tiers and documentation are becoming legal duties.

  4. From one model to model systems. A single OTA package can carry perception, planning and monitoring models, each with its own provenance and rollback dependencies.

3. Current state of research

Cloud MLOps is largely solved with standard tools. The open problems for physical AI sit at the edges: shipping model systems to thousands of intermittently connected machines, monitoring them with little bandwidth, and proving provenance end to end.

Dominant frameworks

Key research questions

QuestionState of evidence
How can model quality be monitored on machines with little bandwidth?Tiered telemetry: summaries always, samples on triggers, full logs rarely (Red Hat)
Where should drift be detected: on the machine or centrally?Central aggregation can miss drift in small subsets of devices; on-device checks help (US patent 12688110)
How is a model system versioned, not just a model?Package-level versions with per-model provenance; dependency-aware rollback (practice proposal; little published evidence)
What lineage is enough for audit?Run + data + code + evaluation + approval + deployment; AIBOMs still lack AI-specific assurance fields (AIRS, arXiv 2511.12668)
How should models that learn after deployment be governed?Open; most regulated products freeze models between releases

Challenges for heavy equipment

Debates

4. Key stakeholders and research centers

MLOps is shaped by platform vendors and open-source projects more than by academia; governance by standards bodies and regulators.

ClusterWhoContribution to this canvas
Registry and tracking platformsDatabricks (MLflow, Unity Catalog); Weights & Biases; Google Vertex AI; AWS SageMaker; Azure MLRegistries, lineage, approvals
Open-source MLOpsMLflow, Kubeflow, KServe, Argo, DVC/lakeFS, OpenLineage, FeastComponents for an assembled stack
NVIDIA stackNGC registry, NVIDIA AI Enterprise, Fleet Command, OSMOModel packaging and edge deployment in the NVIDIA ecosystem
Edge fleet managementPeridio / Avocado OS (Jetson), Red Hat FlightCtl and OpenShift AI, Mender, AWS IoT Greengrass, Azure IoT Edge, Foundries.ioOTA, rollback, cohort targeting on edge devices
Supply chain and AIBOMOWASP (CycloneDX, AIBOM initiative), Linux Foundation (SPDX), Sigstore and OpenSSF model signingProvenance and signing standards
Governance standards and regulatorsISO/IEC JTC 1/SC 42 (42001, 23894); NIST (AI RMF); European Commission (AI Act, Machinery Regulation delegated acts); UNECE (R156 software updates)Rules and frameworks
ResearchSculley et al. (Google, ML technical debt); Mitchell, Gebru (model cards, datasheets); CMU SEI (ML engineering)Foundations of ML engineering practice

Inside heavy-equipment OEMs and autonomy developers (public evidence).

Debate. Who owns the AI inventory and risk classification: IT governance, product safety, or legal? In practice it needs all three, with one accountable owner.

5. Methodological landscape

Methods group by lifecycle stage. Defaults are mature; the frontier is edge-specific.

StageDefault methodFrontier
TrackLog every run: code commit, container digest, dataset IDs, config, seed, metricsAutomatic capture from orchestrator, no manual logging
RegisterRegister versions with signatures; aliases for candidate, approved, deployed; enforced model signatures (Marvelous MLOps)Registry enforces policy (no evidence, no promotion)
ApproveRisk-tiered approval: light for internal tools, full board for safety functionsPolicy-as-code approvals tied to canvas 4 evidence
PackageContainer or engine file + config + AIBOM; signed (Sigstore or hardware-backed CA) (Petronella)Attestation graphs linking every artifact
Deploy to fleetAtomic, image-based OTA; phased cohorts; air-gapped delivery where needed (Peridio)Delta updates for large models over weak links
MonitorOn-machine summaries (confidence, OOD rate, latency); field KPIs; intervention rates; sampled uploadsOn-device drift detection with central root-cause analysis (Nazar, arXiv 2305.07772)
RespondAutomatic rollback on anomaly; incident reviewComponent-level rollback inside a model system
RetireDeprecation notice; archive with lineage; delete per retention policyAutomated end-of-support across hardware generations

Governance methods

Analysis techniques

6. Interdisciplinary connections

The registry is the system of record every other canvas writes to or reads from.

Connects toWhat crosses the boundaryContract to define
Canvas 1: data flywheelDataset IDs and hashes; field-monitoring triggers back into miningShared lineage IDs (OpenLineage); monitoring alerts become data requests
Canvas 2: simulationSimulator and asset versions used in training and evaluationSimulator version recorded per model
Canvas 3: trainingRun manifests and checkpointsRegistry rejects checkpoints without complete manifests
Canvas 4: evaluationGate results and safety-case evidenceNo promotion without a stored, passed gate
Canvas 6: GPU infrastructureTraining and evaluation jobs triggered by the release pipelinePipeline service accounts and quotas
Canvas 7: inferenceOptimized engines as registered artifactsEngine built from a registered model; both versions linked
Canvas 8: observabilityModel-quality metrics alongside platform metricsShared metric names and dashboards
Canvas 9: reference architectureLifecycle as a platform standard across an organizationOne registry, one AIBOM format, one release process

Outside fields

7. Future directions

The lifecycle is moving from human-run processes to automated, policy-driven pipelines that produce audit evidence as a by-product. The trends below are directions, not predictions with dates.

Emerging trends

  1. Governance as code. Approval rules, risk tiers and required evidence encoded and enforced by the registry and CI.

  2. Attested supply chains. Every model, dataset and container signed and linked in an attestation graph (Petronella).

  3. AIBOM by default. Generated from instrumentation, not written by hand; one practitioner source reports procurement and regulators already ask for it (Tian Pan).

  4. Model-system releases. Versioning and rollback of bundles (perception + planner + monitor) as one unit with internal dependencies.

  5. Edge-native monitoring. Drift detection on the machine, with only summaries and trigger samples uploaded.

  6. Sector-specific AI rules. For machinery, AI requirements are set to move into the Machinery Regulation via delegated acts rather than the AI Act (EUROGIP).

  7. Software-defined heavy equipment. OEM statements point to machines that change through software over their service life (Komatsu), which raises the importance of every item above.

Research gaps in heavy-industry physical AI

GapWhy it is openOpportunity
Monitoring under very low bandwidthMost edge MLOps assumes regular connectivityBudgeted telemetry designs for mines and remote sites
Lifecycle over long machine livesMLOps practice assumes short product cyclesSupport policies across compute-hardware generations; model end-of-life rules
Customer-consented updatesConsumer OTA assumes manufacturer controlUpdate workflows integrated with dealers and customer fleet managers
Retrofit autonomy lifecycleAutonomy kits on third-party machines split ownership of software and safety evidenceInterface contracts for updates and evidence between kit maker and machine maker
Evidence reuse across regulationsMachinery Regulation, ISO 17757, ISO 42001 and customer audits ask for overlapping evidenceOne evidence store mapped to each regime

Potential breakthroughs

8. Resources and infrastructure

Tools and platforms, by layer

LayerOpen source / standardsCommercial / vendor
Tracking and registryMLflow 3 (OSS), Kubeflow Model Registry, AimDatabricks Unity Catalog, Weights & Biases, Vertex AI, SageMaker
Pipelines and CI/CDArgo Workflows and CD, Tekton, GitHub Actions, Kubeflow PipelinesAzure DevOps, GitLab
LineageOpenLineage, Marquez, DataHubUnity Catalog lineage, Collibra
Packaging and signingOCI artifacts, Sigstore / cosign, OpenSSF model signingNGC private registry
AIBOMCycloneDX 1.6 ML-BOM (ECMA-424), SPDX 3.0 AI profile—
Edge fleet deploymentMender, FlightCtl, K3s / KubeEdgePeridio, AWS IoT Greengrass, Azure IoT Edge, NVIDIA Fleet Command
MonitoringEvidently, Prometheus / Grafana, TrustyAIArize, Fiddler, WhyLabs
GovernanceISO/IEC 42001 templates; NIST AI RMF playbookCredo AI, IBM watsonx.governance, OneTrust

Standards

Conferences and journals

Funding sources

9. Literature analysis

MLOps literature is mostly practitioner writing and standards; a few papers define the field.

Recent influential works (2023–2026)

YearWorkOne-line takeaway
2026Regulation (EU) 2026/1744 (Digital Omnibus on AI)Machinery leaves the AI Act's direct scope; requirements to arrive via Machinery Regulation delegated acts (DLA Piper)
2026Red Hat, MLOps for edge AI seriesTiered telemetry and feedback loops for edge fleets (Red Hat)
2025Nathanson et al., AIRS frameworkAIBOMs need verifiable security-assurance fields beyond SPDX 3.0 and CycloneDX 1.6
2025MLflow 3Logged models and deployment jobs; registry as governance hub
2023ISO/IEC 42001Certifiable AI management system
2023Hutchinson et al. / Shankar et al., operationalizing ML interview studiesWhat production ML teams actually do
2023Nazar: Monitoring and Adapting ML Models on Mobile DevicesOn-device drift detection plus cloud root-cause analysis

Seminal works

YearWorkContribution
2015Sculley et al., Hidden Technical Debt in ML SystemsML-specific engineering debt
2017Breck et al., The ML Test ScoreChecklist for production readiness
2019Mitchell et al., Model Cards for Model ReportingStandard model documentation
2021Gebru et al., Datasheets for DatasetsStandard dataset documentation
2020Paleyes et al., Challenges in Deploying ML: a surveyDeployment failure modes
2022Kreuzberger et al., MLOps: Overview, Definition, and ArchitectureReference definition and architecture

Gap in the literature: the author found almost nothing published on lifecycle management for learned models on long-lived heavy machinery fleets (absence in a limited search, not proof of absence).

10. Practical applications

Heavy-industry model portfolios need at least two release tracks: a fast track for models that do not touch machine safety, and a gated track for those that do. The table is a field-level proposal, not a description of any organization.

Application areaRelease trackDeployment targetLifecycle notes
Person and obstacle detection (construction and mining)Gated (safety)On-machine edge computeFull lineage; staged OTA; rollback tested every release
Construction autonomy policies (excavation, dozing, grading)Gated (safety)On-machine computeBundled with planner and monitors; component-level rollback; for retrofit kits, evidence interfaces with the machine maker
Mining haulage autonomyGated (safety)On-truck compute plus site fleet-management systemSite-by-site staged rollout; customer-approved change windows
In-cab and operator assistance (voice or vision assistants)Fast, with content-safety gatesOn-machine and cloudFrequent updates; hallucination and safety monitoring; no covert operator monitoring
Predictive maintenanceFastCloudDrift monitoring on telemetry; retrain on schedule
Jobsite digital twins and planningFastCloudLinked to site data products and simulator versions (canvas 2)

Industry connections

Future applications (labeled as possibilities): customer-visible model versions and release notes per machine; automated compliance reports per market.

11–12. Technology integration, ethics and regulation

Technology integration

Ethical considerations

Regulatory requirements

RuleStatus (as of November 2026)What it means for the lifecycle
EU AI Act as amended by Regulation (EU) 2026/1744In force 27 July 2026 (Cooley)Machinery removed from direct AI Act high-risk scope; stand-alone high-risk dates moved to 2 December 2027, embedded to 2 August 2028 (ISMS.online)
EU Machinery Regulation 2023/1230Applies 20 January 2027Commission to add AI Act high-risk requirements (risk management, data governance, logging, post-market monitoring) into its Annex III by delegated act (euaiact.com); timing of that act still open
ISO/IEC 42001Voluntary, certifiableA governance base that maps onto both regimes, but not a substitute for conformity (Holistic AI)
EU Data ActApplies from September 2025Customers' right to access machine data affects monitoring and data reuse
UNECE R155/R156For road vehicles; R156 in force from 22 January 2021 (EUR-Lex); reference practiceSoftware-update management system as a model for OTA governance

Implication: a lifecycle designed to produce the evidence the Machinery Regulation's coming AI requirements are expected to ask for (risk management, data governance, logging, post-market monitoring) is better placed even before the delegated act is final. Worker groups have criticized the carve-out (Social Europe), so expect scrutiny.

13. Implementation framework

Build in four phases. Start with an inventory and one registry; automate approvals and fleet rollout once the records exist.

Lifecycle rollout: four phases, three gates
lifecycle rollout · 4 phases, 3 gates

Phases are sequenced, not dated. Phase 1 is highlighted because governance can't apply to models nobody has listed.

Required resources

Risk assessment (likelihood and impact are the author's qualitative estimates)

RiskLikelihoodImpactMitigation
Bad model reaches many machinesMediumHighStaged cohorts; automatic rollback; gated track for safety models
Lineage gaps found during an audit or incidentMediumHighRegistry blocks versions without complete manifests and evidence
Parallel shadow MLOps stacks in product teamsHighMediumPaved road that is faster than workarounds; central inventory mandate
OTA fails at remote sitesMediumMediumDual-slot install; resume-able, delta downloads; dealer-assisted updates
Regulation changes under the programHighMediumEvidence store mapped to requirements, not to one law
Compromised third-party modelLowHighSignature and hash checks; AIBOM; scanning before registration

Success metrics

MetricWhat it shows
Deployed models fully traceable to data, code, evaluation and approval (%)Governance completeness
Time from approved model to fleet-wide deployment (days)Delivery speed
Releases rolled back (%) and time to rollback (hours)Release safety
Time to detect a field regression (hours)Monitoring effectiveness
Machines on a supported model version (%)Fleet hygiene
AI systems in the inventory with a risk tier and owner (%)Inventory coverage

Set targets after phase 1 baselines.

Open questions and follow-up prompts

Open questions for practitioners

Follow-up prompts (from the research-area framework)

  1. Elaborate on a registry data model linking datasets, runs, models, engines, evaluations and deployments.

  2. Provide detailed methods for staged OTA rollout of a person-detection model to a mixed-connectivity fleet.

  3. Analyze what the coming Machinery Regulation AI delegated act may require from the lifecycle.

  4. Suggest a telemetry design for drift detection under a fixed daily upload budget.

Sources