GCP Senior Data Lead

  • $48 Per Hour

Highlights

Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace. Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Numbers & Facts

Location

Description

Job Title: Eligible to workP Data Platform

Job Location: USA (Remote)

Pay Rate: $48 per hour on W2

Job Description

Key Responsibilities and Requirements

  • Administer, configure, maintain, and upgrade the Eligible to workP Composer (Apache Airflow) environment. (Mandatory)

  • Design and implement Infrastructure as Code (IaC) using Terraform for provisioning and managing Eligible to workP resources. (Mandatory)

  • Create Terraform modules and publish them in TFE (Terraform Enterprise).

  • Perform DAG deployment, troubleshooting, performance tuning, and operational support.

  • Support and Eligible to workimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.

  • Maintain Eligible to workP infrastructure, including the following services:

  • Eligible to workP Composer (Apache Airflow)

  • Google Cloud Storage (Eligible to workS)

  • BigQuery (BQ)

  • Cloud Dataflow / Apache Beam

  • Cloud Dataproc

  • Cloud Functions (Mandatory)

  • Cloud Run

  • Pub/Sub

  • Cloud SQL

  • Secret Manager

  • Logging & Monitoring

  • Monitor Eligible to workP usage and quotas and proactively prevent quota-related issues.

  • Set up and manage alerting by creating alert policies in Eligible to workP Monitoring. (Mandatory)

  • Manage CI/CD pipelines using Jenkins and/or other CI/CD tools. (Mandatory)

  • Request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.

  • Ensure security, compliance, and cost-efficiency across the cloud environment.

  • Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.

  • Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.

  • Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.

  • Demonstrate excellent problem-solving and troubleshooting skills.

Nice-to-Have Skills

  • Experience with CDC platforms such as Striim.

  • Experience with ServiceNow integrations and operational workflows.

  • Knowledge of FinOps, cloud cost Eligible to workimization, and governance frameworks.

  • Understanding of networking components, including:

  • VPCs and Shared VPCs

  • VPC Connectors

  • Firewall Rules

  • CIDR Ranges

  • Exposure to the healthcare domain.

Disclaimer: Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination, based solely on their qualifications, ability, competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error, please disregard it and notify the sender. If you no longer wish to receive our communications, you may unsubscribe at any time.

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Similar Jobs