Build and optimize Azure-based data platforms using Databricks, Data Lake, Synapse, and related technologies. Responsibilities: Design, develop, and maintain scalable data ingestion, transformation, and ETL/ELT pipelines.
Numbers & Facts
Location
Mason, OH
Description
Our Client, an IT Services and Consultant company, is looking for a Sr. Azure Data & ML Engineer - Databricks, Python & MLOpsr for their Mason, OH/ Hybrid location.
Responsibilities:
Design, develop, and maintain scalable data ingestion, transformation, and ETL/ELT pipelines.
Build and optimize Azure-based data platforms using Databricks, Data Lake, Synapse, and related technologies.
Support deployment and operationalization of machine learning models through CI/CD and MLOps practices.
Implement monitoring, logging, troubleshooting, and performance optimization for data and ML workloads.
Collaborate with data scientists and engineering teams to translate requirements into production-ready solutions.
Develop reusable, automated components following cloud engineering best practices.
Requirements:
Proven hands-on experience as a Data Engineer, ML Engineer, or Cloud Platform Engineer.
Strong experience with Microsoft Azure data engineering services.
Proficiency in Python, SQL, and/or Scala.
Experience developing and supporting production-grade data pipelines.
Experience with Spark, Databricks, or comparable big data processing frameworks.
Familiarity with CI/CD pipelines, DevOps, and MLOps practices.
Ability to independently design, develop, troubleshoot, and deliver technical solutions.
Strong communication skills and experience working with cross-functional teams.
Preferred Qualifications
Experience with Azure Data Factory, Synapse Analytics, and Azure Data Lake.
Experience with MLflow, Docker, Kubernetes/AKS, and containerized workloads.
Knowledge of Delta Lake, Parquet, and other common data formats.
Experience with infrastructure as code, orchestration tools, and cloud monitoring.
Exposure to enterprise data integrations, including SAP CDC.
Experience working in Agile development environments