Data Engineer

TechDigital

  • Minneapolis, MN
  • 1 day ago

    Highlights

    Cloud Technology Expertise: * Leverage Azure cloud services (Azure Data Lake Storage, Azure Synapse Analytics) to store and process data. * Collaborate with data engineers to design and implement data pipelines using Azure Data Factory (ADF).

    Numbers & Facts

    LocationMinneapolis, MN
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Description

    Responsibilities:
    * Analyze large and complex datasets to identify trends, patterns, and anomalies.
    * Use statistical techniques and data mining tools to extract meaningful insights.
    * Prepare data visualizations (dashboards, reports) to communicate findings effectively.
    * Data Engineering:
    * Collaborate with data engineers to design and implement data pipelines using Azure Data Factory (ADF).
    * Utilize Databricks to process and transform large datasets efficiently.
    * Develop and maintain data quality checks and validation processes.
    * SQL Proficiency:
    * Write complex SQL queries to extract, transform, and analyze data from relational databases.
    * Optimize SQL queries for performance and scalability.
    * Cloud Technology Expertise:
    * Leverage Azure cloud services (Azure Data Lake Storage, Azure Synapse Analytics) to store and process data.
    * Utilize Azure Databricks for data engineering and analysis tasks.
    * Data Governance:
    * Adhere to data governance policies and standards.
    * Ensure data security and privacy.
    * Collaboration:
    * Work closely with business stakeholders to understand their data needs.
    * Collaborate with data scientists and engineers to build data products.

    Qualifications:
    * 10+ years of experience in data analysis and data engineering.
    * Strong proficiency in SQL and data querying languages.
    * Experience with data visualization tools (e.g., Power BI, Tableau).
    * Hands-on experience with Azure cloud technologies, including Databricks and ADF.
    * Knowledge of statistical techniques and data mining algorithms.
    * Excellent problem-solving and analytical skills.
    * Strong communication and presentation skills.

    Similar Jobs

    See more jobs