Senior Data Platform Engineer
Onsite Phoenix, AZ
Job Description
We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ.
This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.
Key Responsibilities:
- Design and maintain Airflow DAGs for production data workflows
- Develop and optimize Spark / PySpark jobs on Dataproc
- Build and optimize complex SQL transformations
- Develop REST APIs using FastAPI Python to support data services
- Implement robust data quality and validation frameworks
- Monitor pipeline performance, retries, and SLA compliance
Required Skills:
- 6+ years of data engineering experience
- Strong Python programming skills
- Production experience with Apache Spark PySpark
- Experience with Airflow DAG development
- Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
- Experience building APIs using FastAPI
- Strong SQL and data modeling knowledge
- Experience implementing data quality checks (schema validation, row count checks, anomaly detection)