Senior Data Engineer

Data Engineer || Fulltime || Chicago, IL - Onsite

Job Description

Must Have Technical/Functional Skills

• ETL/ELT concepts (pipelines, incremental loads, validation)
• Advanced SQL (CTEs, joins, performance tuning)
• Python (modular code, testing, CI/CD)
• PySpark (distributed processing, optimization)
• Azure Data Factory (pipelines, triggers, monitoring)
• Databricks (Delta Lake, workflows, clusters)
• Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal)
• Pulumi (Infrastructure as Code)
• Azure API Services
• Azure Function Apps

Roles & Responsibilities

• Design and build end-to-end data pipelines
• Develop and optimize SQL and PySpark transformations
• Build production-grade Python components
• Create and maintain ADF pipelines
• Work within Azure environments
• Provision Azure resources using Pulumi
• Participate in code reviews, documentation, and operational support

Salary : 100K-120K/annum + Benefits

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.