Senior Data Engineer

Description

Title: Senior Data Engineer

Location: Phoenix, AZ

Duration: 12 months

Work Engagement: W2

Work Schedule: Hybrid 3 days in office/2 days remote

Benefits on offer for this contract position: Health Insurance, Life insurance, 401K and Voluntary Benefits

Summary:

In this contingent resource assignment, you may: Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables. Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors. Contribute to the resolution of moderately complex issues and consult with others to meet Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements. Collaborate with client personnel in Software Engineering. Required Qualifications: Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

Key Requirements:

• Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship.

• Experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions: creating/supporting Spark based processing, Kafka streaming, in a highly collaborative team

• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming

• Experience with Data lakehouse architecture and design, including hands-on experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer

• Working with NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats

• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics

Desired Qualifications:

• Proven skills with data migration from on-prem to a cloud native environment

• Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables

• Deep understanding of data warehouse, data cloud architecture, building data pipelines, and orchestration

• Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance

• Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent-based data capabilities

• Dev Ops and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes

• Web based UI development using React and Node JS is a plus