Snowflake Data Engineer Data Governance
Role Overview:
We are seeking a highly experienced and strategic Snowflake Data Engineer with expertise in data governance to join our growing data team. This pivotal role will be instrumental in shaping our data architecture, ensuring data quality, security, and compliance, and driving the adoption of best practices for data management within our Snowflake environment. You will be responsible for designing, developing, and implementing robust data solutions, with a strong focus on establishing and maintaining comprehensive data governance frameworks, including data cataloging, lineage tracking, and policy enforcement.
Key Responsibilities:
a Snowflake Data Engineering
Architecture: Design, develop, and optimize robust, scalable, and secure data pipelines and solutions within Snowflake. Architect and implement data models, transformations, and data flows that support business needs and future growth.
a Integrations
APIs: Lead the design and implementation of data integration strategies, including the development and consumption of APIs, ETL/ELT processes, and real time data streaming solutions to connect various data sources with Snowflake.
a Solution Design
Strategy: Collaborate with stakeholders to understand business requirements and translate them into effective data engineering solutions. Provide architectural and strategic guidance, evaluating various design options and recommending the best approaches.
a Data Governance Leadership: Champion and implement data governance best practices across the organization. Take ownership of our Snowflake data governance strategy, focusing on:
a Data Cataloging: Implementing and managing a comprehensive data catalog (e.g., Horizon Data Catalog) to ensure discoverability, understanding, and accessibility of data assets.
a Data Lineage: Establishing and maintaining end to end data lineage tracking to provide transparency and traceability of data flows.
a Data Quality
Compliance: Defining and enforcing data quality rules, policies, and standards to ensure data accuracy, consistency, and compliance with regulatory requirements.
Cisco Confidential
a Access Control
Security: Implementing robust data security measures and access controls within Snowflake.
a Risk Assessment
Mitigation: Proactively identify potential risks associated with data solutions and governance processes. Develop and implement mitigation strategies to ensure data integrity, security, and reliability.
a Technical Leadership
Mentorship: Provide technical leadership, mentor junior engineers, and foster a culture of innovation and continuous improvement within the data engineering team.
a Cross functional Collaboration: Work closely with data scientists, analysts, business users, and other engineering teams to deliver data driven insights and solutions.
a Testing
Validation: Develop and execute comprehensive testing strategies to ensure the quality, performance, and reliability of data pipelines and governance controls.
Required Qualifications:
a Bachelor's or master's degree in computer science, Engineering, Information Technology, or a related field, or equivalent practical experience.
a 5+ years of experience in data engineering, with a significant focus on Snowflake.
a Proven expertise in designing, developing, and deploying complex data solutions, ETL/ELT processes, and data warehousing concepts within Snowflake.
a Strong experience with data integration patterns, including API development and consumption (REST, SOAP), and real time data streaming technologies.
a Demonstrated experience in defining and implementing data governance frameworks, including data cataloging, data lineage, data quality, and metadata management.