Data Engineer

TechDigital

  • Bellevue, WA
  • 23 days ago

    Highlights

    Undertake Unit testing making full utilization of automation tools available and working with the system test team to ensure tests are integrated as. Design and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).

    Numbers & Facts

    LocationBellevue, WA
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Description

    Mandatory Skills: Vectr and Cribl
    8+ years of experience.
    1. Design and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).
    2. Build and manage API integrations for data exchange between systems.
    3. Write and optimize SQL queries and stored procedures for data transformation and analysis.
    4. Implement Azure cloud services, including Azure Data Lake, Azure SQL Database
    5. Develop Python-based data processing solutions for automation and orchestration.
    6. Monitor, troubleshoot, and optimize data workflows and pipelines.
    7. Ensure data security, governance, and compliance with industry standards.
    8. Undertake Unit testing making full utilization of automation tools available and working with the system test team to ensure tests are integrated as
    9. part of the overall test plan.
    10. Good multi-tasking and flexibility to stretch when situation demands.

    Similar Jobs

    See more jobs