AI & ML Ops Engineer

The engineer partners with data scientists, data engineers, central cloud and infrastructure teams, API and Interoperability teams, Cybersecurity, service owners, and relevant engineering teams to deliver maintainable solutions. Work may include agents, retrieval-augmented generation, orchestration, APIs and integrations, automated evaluation and testing frameworks, observability, monitoring, release and rollback processes, and model/application lifecycle management.

Responsibilities/Job Description:

The AI & ML Operations Engineer designs, builds, and maintains the engineering processes and platform capabilities needed to deploy, monitor, govern, and maintain deployed AI/ML solutions at scale. The role converts validated analytical work into reliable production solutions and manages the operational lifecycle of models and related services while meeting enterprise privacy, security, and support standards.

 

The engineer partners with data scientists, data engineers, central cloud and infrastructure teams, API and Interoperability teams, Cybersecurity, service owners, and relevant engineering teams to deliver maintainable solutions. The role remains hands-on in engineering, testing, deployment, and troubleshooting while using enterprise-managed capabilities for production data movement, integration, and infrastructure. Scientific method validation remains with the Data Scientist and designated reviewers; this position implements the operational controls for deployed solutions.

 

This role is part of a new AI & Automation engineering team and will directly design, build, deploy, and support production AI applications and services. Work may include agents, retrieval-augmented generation, orchestration, APIs and integrations, automated evaluation and testing frameworks, observability, monitoring, release and rollback processes, and model/application lifecycle management.

 

Responsibilities

 

Model deployment and orchestration. Deploy batch and real-time models and related AI services using approved CI/CD, containers, APIs, and workflow patterns. Build and maintain assigned model deployment and runtime components and coordinate dependencies with enterprise platform owners.

 

Release management. Automate packaging, versioning, testing, promotion, rollback, and recovery for models and services. Implement retraining or recalibration workflows using criteria defined with data scientists and the required validation and release approvals.

 

ML platform capabilities. Implement, integrate, configure, and operate approved feature stores, model registries, experiment tracking, and related ML lifecycle capabilities with enterprise platform owners. Partner with Cloud & AI Deployment Engineering and central cloud teams on compute, storage, networking, and deployment.

 

Deployed-model governance. Implement approved lifecycle controls, access restrictions, lineage, audit trails, change records, and release approvals for deployed models. Maintain traceability across data, code, model, and configuration versions.

 

Monitoring and reliability. Implement logging, alerts, and monitoring for model performance, drift, data quality, latency, availability, and errors. Work with data scientists, service owners, and relevant engineering teams on measures, thresholds, incident response, and service objectives.

 

Data and API integration. Work with central data-engineering teams on managed data pipelines and with enterprise API and Interoperability teams on real-time and application integrations, including MuleSoft or other approved API capabilities. Coordinate monitoring, recovery checkpoints, restart procedures, security, and support ownership.

 

Enterprise support and maintainability. Ensure production solutions have documented dependencies, operational procedures, escalation paths, and ongoing ownership before release. Arrange support with the responsible enterprise teams, including 24/7 coverage where required for critical services, rather than relying on an individual project owner.

 

AI application operations. Operate assigned LLM, retrieval-based, and agent applications using automated quality checks, model/tool tracing, prompt and configuration versioning, and usage/cost monitoring within the common production lifecycle.

 

Security and engineering standards. Apply enterprise privacy, security, encryption, role-based access, and sensitive-data controls. Follow common infrastructure-as-code, pull-request, and deployment practices with the responsible teams; bring needed tooling or design exceptions through established review processes.

 

Collaboration and improvement. Help scientists and partner teams move prototypes into supported production solutions. Review code, tests, and documentation, resolve incidents across dependencies, provide constructive technical feedback, and improve reliability, reproducibility, performance, and efficiency.

 

Required Qualifications

• B.S./B.A. in Computer Science, Engineering, Information Systems, or a related field, or an equivalent combination of education and relevant experience.
• At least three years of experience in software engineering, DevOps, or MLOps, including work with production systems.
• Proficiency in Python or another modern programming language, such as Java or Go, sufficient to build, test, troubleshoot, and maintain production components.
• Hands-on experience deploying and operating batch and/or real-time machine-learning models in production.
• Experience with CI/CD tools such as GitHub Actions, GitLab CI, Jenkins, or Azure DevOps; source control, code review, automated testing, and controlled releases.
• Hands-on experience with containerization and orchestration technologies using enterprise-approved platforms and tools.
• Experience in cloud and/or hybrid environments such as AWS, Azure, or GCP.
• Working knowledge of SQL and experience with large datasets and data-workflow orchestration; ability to integrate model services with enterprise-managed pipelines and APIs.
• Experience implementing logging, metrics, monitoring, alerts, and operational diagnostics and investigating failures across model, application, data, and infrastructure dependencies.
• Understanding of security best practices, role-based access control, secrets management, and handling sensitive data.
• Ability to independently deliver assigned engineering work, communicate technical tradeoffs, and collaborate with data scientists, clinicians, data/API teams, cloud/DevOps, security, and support functions.

Preferred Qualifications

• Experience in healthcare, health technology, or another regulated industry handling PHI/PII.
• Familiarity with EHR/EMR integration and healthcare data standards such as HL7/FHIR, ICD, CPT, LOINC, or SNOMED.
• Experience with ML lifecycle tools such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure ML, including model registries, feature stores, and experiment tracking.
• Experience with ETL/ELT, data warehouse or lakehouse platforms, enterprise API platforms, infrastructure as code, and formal production-support practices.
• Experience monitoring model drift, fairness, and explainability and implementing healthcare AI governance controls.
• Experience operating LLM, retrieval-based, or agent applications, including quality evaluation, tracing, prompt/configuration management, and cost monitoring.

Qualifications:

$109,449.60- $154,523.20 Annual