Lead Data Engineer

TechDigital

  • Chicago, IL
  • 30+ days ago

    Highlights

    6-8 years+ experience on data warehouse experiences – hands on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization / denormalization, dimensions, aggregations etc., 6-8 years+ experience working in reporting and analytics environments – development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc., 6 years+ on Python – advanced Python expertise . Hands on experience on AWS on Lambda , S3, SNS / SQS, EC2 is a bare minimum, 6 years+ on any ETL / ELT tool – Informatica, Fivetran, DBT, Airflow etc.

    Numbers & Facts

    LocationChicago, IL
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Description

    Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT

    Job Description:
    Required Skills:

    6-8 years+ experience on Snowflake SQL – advanced SQL expertise
    6-8 years+ experience on data warehouse experiences – hands on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization / denormalization, dimensions, aggregations etc.,
    6-8 years+ experience working in reporting and analytics environments – development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.,
    6 years+ on Python – advanced Python expertise
    6 years+ on any cloud platform – AWS preferred
    Hands on experience on AWS on Lambda, S3, SNS / SQS, EC2 is a bare minimum,
    6 years+ on any ETL / ELT tool – Informatica, Fivetran, DBT, Airflow etc. - Must
    6 years+ with developing functional metrics in any specific business

    Responsibilities:
    • Lead data warehouse development activities for a team, leading more than one project in parallel.
    • Assign data warehouse development tasks to team of 1-6 developers (Onsite/Offshore).
    • Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function.
    • Work with minimal supervision and provide status updates and escalation to leadership as appropriate.
    • Provides application support as part of an on-call rotation to work on resolving outages and user questions.
    • Review project objectives and determine best technology to apply.
    • Design and build large scale datasets for a wide range of consumer needs.
    • Build, test and implement highly efficient data pipelines using a variety of technologies.
    • Develop best practice standards for solution design and data structures.
    • Analyze new data sources to understand quality, availability, and content.
    • Write technical design documentation.
    • Conducts peer code reviews.
    • Create and executes unit tests.
    • Supports QA team during testing.
    • Mentor less experienced members of the development team.

    Similar Jobs