GCP Data Engineer (AI Experience)

We are seeking a GCP Data Engineer with AI experience for a contract position based remotely. This is a contract-to-hire opportunity with a 6-month initial term.

Responsibilities

• Design and implement robust data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Pub/Sub
• Develop and manage workflows using Cloud Composer (Apache Airflow) for efficient scheduling and orchestration
• Write clean, efficient, and scalable code in Python, leveraging advanced programming techniques
• Craft complex SQL queries in BigQuery, including window functions, CTEs, and performance tuning strategies
• Build and maintain real-time data processing systems using Apache Kafka
• Model and manage NoSQL databases, particularly MongoDB, with a focus on scalable schema design
• Utilize Shell scripting and perform Linux system administration tasks to support data infrastructure
• Conduct data profiling and implement validation techniques to ensure data quality and integrity
• Develop and maintain API integration scripts for seamless service automation and data exchange
• Troubleshoot and resolve data-related issues with strong analytical and problem-solving skills
• Create and maintain data flow diagrams to clearly communicate architecture and pipeline logic to stakeholders

Qualifications

• Required: Minimum 7 years of proven hands-on experience with GCP data services
• Required: Minimum 3 years of proven hands-on experience with the core responsibilities listed above
• Required: Demonstrated experience with AI technologies (GPT, Gemini) with clear, business-focused use cases highlighted on resume
• Required: Strong understanding of distributed systems and data engineering best practices
• Required: Excellent communication and documentation skills
• Required: Ability to work independently and collaboratively in a fast-paced environment
• Required: Experience with Agile methodology
• Required: Experience working in onshore/offshore support model, collaborating effectively with offshore teams
• Preferred: GCP Google Cloud Professional Data Engineer Certification
• Preferred: Experience with SAFe methodology
• Preferred: Experience working with GitHub, RTC, and automation tools

Additional Requirement: Candidates must complete a ROPES Assessment.