Lead Data Engineer - Azure Databricks & Snowflake

Job Title: Lead Data Engineer - Azure Databricks & Snowflake

Location: Boston, MA - Remote 100%

Contract

Position Summary:

Seeking an experienced Senior Data Engineer with 15+ years of expertise in building scalable cloud-based data platforms, data lakes, and data warehouses. The ideal candidate will have strong hands-on experience with Azure, Databricks, Snowflake, PySpark, Python, and AWS, along with a proven ability to deliver enterprise data and analytics solutions.

Key Responsibilities:

• Design and develop data pipelines, ETL/ELT frameworks, and Lakehouse solutions using Azure, Databricks, and Snowflake.
• Build and Eligible to workimize large-scale data processing solutions using Python, PySpark, and SQL.
• Develop data models, data warehousing solutions, and cloud migration strategies.
• Implement data quality, governance, monitoring, and performance tuning best practices.
• Collaborate with business stakeholders, architects, and development teams to deliver analytics and reporting solutions.
• Support CI/CD and DevOps processes using Git and Azure DevOps.

Required Skills:

• Azure Databricks, Azure Data Factory (ADF), Azure Data Lake (ADLS), Synapse Analytics.
• Snowflake, DBT, Python, PySpark, Spark SQL, SQL.
• AWS services including S3, Glue, EMR, Lambda, and Athena.
• Data warehousing, dimensional modeling, and ETL/ELT development.
• Git, Azure DevOps, and Agile delivery methodologies.

Preferred Skills:

• Microsoft Fabric, Power BI, and AI/LLM-enabled data solutions.
• Experience leading cloud modernization and data migration initiatives.

Disclaimer: Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination, based solely on their qualifications, ability, competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error, please disregard it and notify the sender. If you no longer wish to receive our communications, you may unsubscribe at any time.

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.