Data Engineer

Diverse Lynx, LLC

  • West Chester, PA
  • 12 days ago

    Highlights

    Role Descriptions: Pipeline Development: Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs| flat files| and relational databases. Data Quality & Integrity: Implement automated data validation frameworks and testing procedures to ensure a ""single source of truth"" and high data reliability.

    Numbers & Facts

    LocationWest Chester, PA

    Description

    Role Descriptions: Pipeline Development:

    Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs| flat files| and relational databases

    Data Modeling:

    Develop and manage complex data models (e.g.| Star/Snowflake schemas) and maintain Fact and Dimension tables within Snowflake

    Performance Optimization:

    Monitor and tune Snowflake queries and Spark jobs to optimize performance| reduce latency| and manage computational costs

    Data Quality & Integrity:

    Implement automated data validation frameworks and testing procedures to ensure a ""single source of truth"" and high data reliability

    Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

    Similar Jobs

    See more jobs