Piper Companies is seeking a Senior Data Engineer to support a growing client in the healthcare industry in the DMV area. The Senior Data Engineer role will be fully remote. The Senior Data Engineer role is best suited for a seasoned data professional with strong experience building scalable data platforms, modern ingestion frameworks, and working within AWS and Databricks environments.
Responsibilities of the Senior Data Engineer include:
- Architect, build, and maintain scalable data pipelines leveraging AWS and Databricks to support healthcare data initiatives.
- Develop and optimize ingestion frameworks utilizing API integrations, CDC, and event-driven processing with PySpark and Spark Structured Streaming.
- Create and manage transformation workflows using SQL, Python, and dbt to ensure high-quality, reliable datasets.
- Collaborate closely with analytics, product, and business teams to deliver actionable data solutions and reporting capabilities.
- Monitor, troubleshoot, and enhance data platform performance, ensuring reliability and data quality across systems.
Requirements of the Senior Data Engineer include:
- 5+ years of experience in data engineering or backend engineering with a strong focus on data platforms and pipeline development.
- Prior healthcare industry experience and familiarity with healthcare data systems or regulatory environments.
- Expertise in AWS, Databricks, SQL, and Python, with hands-on experience in distributed data processing.
- Experience with modern ingestion patterns (API, CDC, event-driven pipelines) and orchestration tools such as Airflow or Databricks Workflows.
- Strong understanding of data architecture, performance tuning, and building production-grade data systems at scale.
Compensation for the Senior Data Engineer include:
- $160,000 - $180,000 annually
- Full Comprehensive Benefits: Health, Vision, Dental, PTO, Paid Holiday and Sick Leave if Required by Law.
- Hybrid work flexibility
- This job opens for applications on 07/17/2026. Applications for this job will be accepted for at least 30 days from the posting date.
Keywords: Senior Data Engineer, Data Engineer, AWS, Databricks, SQL, Python, Healthcare, DMV, dbt, PySpark, Data Pipelines, CDC, Airflow
#LI-BM4
#LI-REMOTE