Genesis10 is currently seeking a Senior Big Data Engineer for a hybrid position (2-3 days per week in the corporate office) with an Agricultural Cooperative located in Inver Grove Heights, MN. This is a 6 month contract opportunity.
Compensation: $67.00 - 82.00 per hour, W2
This role will support a variety of projects within the Enterprise Big Data Ingestion Team. The ideal candidate will possess extensive experience in cloud-based data platforms, SQL, Python programming, dbt, orchestration/scheduling tools, and monitoring/observability tools. You will play a critical role in designing, developing, and supporting data ingestion pipelines, ensuring seamless integration of data from various sources to support robust analytics and business intelligence.
Responsibilities:
- Utilize cloud data warehouses using Snowflake and AWS, ensuring optimal performance, security, and scalability of data pipelines
- Develop, optimize, and maintain data processing scripts and applications using Python to support various big data ingestion tasks
- Assist with architecting and implementing of Extract-Load-Transform (ELT) processes, including AWS Lambda functions, to ensure efficient and accurate data loading between systems
- Utilize Snowflake's functionality of tasks, streams, stored procedures, dynamic tables, and dbt (data build tool) to model raw data into a consumable format for data engineers, analysts, and scientists
- Understand business processes, data flows, and strategies for business units and work collaboratively on their data needs
- Produce, maintain, and encourage high-quality documentation to ensure transparency and understanding of data ingestion pipelines and solutions
- Understand, monitor, and enhance data ingestion flows to enable reporting and insights development, including tracking data and job statuses
- Mentor and guide other team members, fostering a culture of continuous learning and development
Requirements:
- Bachelor or Graduate degree in Business Management, Information Management, Computer Science, or other STEM degree program
- 5 years in relevant data engineering positions
- Experience with Snowflake, data pipelines, Kafka, Lambdas, Python, Terraform, and Miro
- Experience with Azure DevOps as code repository
- Loan origination experience
- ETL tools experience, preferably AWS Glue, AWS Lambda, and Apache Airflow
Desired skills:
- Strong understanding of modern, cloud-based data architecture concepts and best practices, including Lakehouse architectures
- Hands-on experience using version control systems such as Git and CI/CD workflows and practices
- Comfortable with ambiguity; able to take ownership, thrive with less oversight and process
- Experience leading other team members and developing technical standards
- Attention to detail and commitment to data and code quality
- Strong analytical and problem-solving skills and an ability to multi-task
- Experience with data observability and monitoring tools, such as Dynatrace, Datadog, Splunk, Monte Carlo, and AWS CloudWatch
Pay range: $77 - $79 per hour
Only candidates available and ready to work directly as Genesis10 employees will be considered for this position.
If you have the described qualifications and are interested in this exciting opportunity, please apply!
Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:
- Access to hundreds of clients, most who have been working with Genesis10 for 5-20 years.
- The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
- Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
- Behavioral Health Platform
- Medical, Dental, Vision
- Health Savings Account
- Voluntary Hospital Indemnity (Critical Illness & Accident)
- Voluntary Term Life Insurance
- 401K
- Sick Pay (for applicable states/municipalities)
- Commuter Benefits (Dallas, NYC, SF, and Illinois)
For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.
Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
#DIG10-MN