Request ID: 110123-1
Title: Azure Data Engineer
Locations: Cary, NC (Local)
Duration: 6 Months
Pay Range: $45 - $52/Hour on W2/C2C (All inclusive)
Introduction
We are seeking a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing and building data pipelines, developing ETL/ELT solutions, and implementing data architectures using Azure technologies. This role requires collaboration with cross-functional teams to optimize data processes and ensure data quality and governance.
Required Skills & Qualifications
- 8 years of experience in data engineering with Azure, specifically using Azure Databricks.
- Strong experience with Azure Data Lake, Databricks, ADF, and Postgres.
- Hands-on expertise in SQL, Python, PySpark, or Scala.
- Proven experience with batch and real-time data ingestion.
- Experience with Kafka and big data processing.
- Prior work experience at client or in client's industry.
Applicants must be able to work directly for Artech on W2.
Preferred Skills & Qualifications
- Experience with Informatica PowerCenter and IDMC or equivalent cloud data integration tools.
- Knowledge of SQL Server, Oracle, Azure SQL, Cosmos DB, Unix/Linux.
- Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data).
- Experience with Azure DevOps (AzDO) and GitHub-based CI/CD.
- Exposure to Generative AI / GenAI use cases in data platforms and analytics.
Day-to-Day Responsibilities
- Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
- Develop ETL/ELT solutions using Spark, SQL, Python/PySpark, or Scala.
- Implement and support Data Lake / Lakehouse architectures.
- Integrate data from legacy and modern platforms, with a preference for Postgres DB migration to Azure Cloud.
- Apply data quality checks and support data governance basics (metadata, lineage, access controls).
- Optimize Spark jobs for performance, reliability, and cost.
- Collaborate with cross-functional teams, product owners, admin teams, BSAs, Scrum, and project managers.
Company Benefits & Culture
- Comprehensive health, dental, and vision insurance.
- 401(k) plan with company match.
- Opportunities for professional development and career growth.
For immediate consideration please click APPLY to begin the screening process with Alex.