Senior Data Engineer - Databricks

RADcube

  • Indianapolis, Indiana
  • 28 days ago

    Highlights

    This role focuses on building and supporting a modern AWS + Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR) . The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development , along with the ability to work closely with both technical and business stakeholders.

    Numbers & Facts

    LocationIndianapolis, Indiana
    Websiteradcube.com

    Description

    Job Title: Senior AWS Data Engineer

    Location: Indianapolis, IN 

    Role Overview

    We are seeking a highly skilled AWS Data Engineer to support a strategic STRADA Modernization initiative. This role focuses on building and supporting a modern AWS + Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR). The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development, along with the ability to work closely with both technical and business stakeholders.

    Key Responsibilities
    • Design, develop, and maintain data ingestion pipelines for real-world data (RWD) sources
    • Build and optimize data models within a Databricks Lakehouse architecture
    • Ensure data governance, quality, and compliance standards are met
    • Optimize cost, performance, and resource utilization across AWS and Databricks
    • Collaborate with business and technical stakeholders to translate requirements into scalable solutions
    • Provide technical guidance, coding standards, and best practices
    • Support knowledge sharing through documentation and training sessions
    • Deliver status updates and progress reports to senior leadership


    Requirements

    Required Qualifications

    • Strong hands-on experience with AWS services (S3, Glue, Lambda, Redshift, etc.)
    • Proven experience with Databricks (Delta Lake, notebooks, workflows)
    • Expertise in SQL and Python
    • Experience building end-to-end ETL/ELT data pipelines
    • Strong understanding of data modeling techniques
    • Experience with data governance, quality, and compliance frameworks
    • Ability to work independently and in a collaborative team environment
    • Databricks Certification 
    • Experience building and managing CI/CD pipelines 
    • Experience with workflow orchestration tools
    • Exposure to data observability and lineage tools
    • Experience with monitoring, logging, and observability frameworks

    Highly Preferred Skills

    • Experience in Healthcare / Pharma domain
    • Exposure to RWD (Real World Data) or HEOR analytics
    • Familiarity with Lakehouse architecture / Medallion (Bronze-Silver-Gold) models
    • Experience optimizing cost and performance in cloud environments
    • Strong communication and stakeholder management skills


    Similar Jobs

    See more jobs