Lead Data Engineer with PySpark

Infinity Outsourcing

  • Mount Laurel, New Jersey
  • 12 days ago

    Highlights

    Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects. Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server .

    Numbers & Facts

    LocationMount Laurel, New Jersey

    Description


    Requisition Title :Lead Data Engineer with PySpark ( 1 Day Onsite)

    Locations Mt Laurel, NJ & Charlotte, NC

    Visa Status: GC/USC/H4 EAD

    Client : TD Bank

    Duration: Full Time /C2H

    Salary pay rate to candidates : $49-$56/hr  W2

    Experience : 12+ Years


    Primary Tech skills = Pyspark, Databricks (Hands-on experience mandatory)


    Secondary Tech skills = Azure, SAS, Synapse, Databricks


    MUST HAVE SKILLS :

    • Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.

    • Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.

    • Ability to drive more than one project in parallel.

    • Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts

    • Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling

    • Hands-on experience in Pyspark is a must.

    • Experience working with structured and unstructured data.

    • Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies

    • Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.

    • Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server

    • Experience with Orchestration tools and GitHub

    • Experience to own end-to-end development, including coding, testing, debugging and deployment.

    • Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill

    • Need to be an individual performer as well as a Lead.

    Similar Jobs

    See more jobs