Lead Data Engineer

Description

Title: Lead Data Engineer

Location: Phoenix, AZ

Duration: 12 months

Work Engagement: W2

Work Schedule: Hybrid 3 days in office/2 days remote

Benefits on offer for this contract position: Health Insurance, Life insurance, 401K and Voluntary Benefits

Summary:

In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Specialty Software Engineering. Review and analyze complex multi-faceted, larger scale, or longer-term Specialty Software Engineering challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented factors. Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables. Strategically collaborate and consult with client personnel. Required Qualifications: Specialty Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

Key Requirements:

• Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship.

• Experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, in a highly collaborative team

• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming

• Experience with Data lakehouse architecture and design, including hands-on experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer

• Working with NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats

• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics

• Proven skills with data migration from on-prem to a cloud native environment

• Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables

• Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration

• Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance

• Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent-based data capabilities

• Dev Ops and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes

• Web based UI development using React and Node JS is a plus