Job Role:Data Engineer with AWS Glue
Job Location: Sacramento, CA (Onsite)
Job Duration: Long Term
Job Summary: We are seeking a highly experienced Senior Snowflake Data Engineer with 10+ years of experience in designing and implementing enterprise-scale data engineering solutions. The ideal candidate should possess strong expertise in Snowflake, AWS Glue, Amazon S3, Amazon Connect, SQL, and cloud-based ETL frameworks. The candidate will be responsible for building scalable data pipelines, optimizing data warehouse performance, and integrating customer interaction data into modern analytics platforms.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Snowflake and AWS services.
- Build and optimize ETL/ELT workflows using AWS Glue for structured and semi-structured data.
- Design, develop, and optimize Snowflake data warehouse objects including databases, schemas, tables, views, tasks, streams, and stored procedures.
- Load and transform data from Amazon S3 into Snowflake using Snowpipe, COPY commands, and automated ingestion pipelines.
- Integrate Amazon Connect contact center data, call records, chat logs, and customer interaction datasets into Snowflake for reporting and analytics.
- Develop scalable data models supporting BI, analytics, and reporting initiatives.
- Optimize Snowflake warehouse performance through clustering, partitioning strategies, query tuning, and resource monitoring.
- Implement incremental data loading, CDC (Change Data Capture), and near real-time ingestion solutions.
- Collaborate with business analysts, architects, and application teams to understand data requirements.
- Monitor data quality, pipeline health, and troubleshoot production issues.
- Implement data governance, security, masking, and access controls within Snowflake.
- Automate deployment processes using CI/CD pipelines.
- Create technical documentation, architecture diagrams, and operational runbooks.
- Mentor junior data engineers and participate in design reviews and best practices.
Required Skills:
- 10+ years of Data Engineering experience.
- 5+ years of hands-on experience with Snowflake.
- Strong experience with AWS Glue for ETL development.
- Hands-on experience with Amazon S3 data storage and ingestion.
- Experience integrating Amazon Connect data into analytical platforms.
- Strong SQL programming and query optimization skills.
- Experience with Python for ETL and automation.
- Experience building ELT pipelines using Snowpipe and Snowflake Tasks.
- Strong understanding of dimensional data modeling (Star Schema/Snowflake Schema).
- Experience with data migration from legacy systems to Snowflake.
- Familiarity with AWS IAM roles, security policies, and encryption.
- Knowledge of performance tuning and workload optimization in Snowflake.
- Experience with Git, CI/CD, and Agile methodologies.
- Strong analytical and problem-solving skills.