GCP Data Platform Engineer w/ DevOps

Euclid Innovations

  • Charlotte, NC
  • 10 days ago

    Highlights

    Google Cloud Platform (GCP): DAGs/Cloud Composer/Airflow, GCS, Cloud Logging Service. Create entitlements and service accounts as needed for automated processes and cross-project access.

    Numbers & Facts

    LocationCharlotte, NC

    Description

    Role: GCP Data Platform Engineer w/ DevOps
    Location: Charlotte, NC (Hybrid, Onsite 3 Days/Week)

    Responsibilities:
    • Create CI/CD pipelines using GitHub Actions and Harness
    • Collaborate with data & ML engineers to productionize their workflows
    • Accountable for NFRs such as observability, pipeline management, execution scheduling, orchestration, and storage volumes
    • Serve as a horizontal enablement resource supporting multiple data and ML engineers
    • Create entitlements and service accounts as needed for automated processes and cross-project access

    Must Have Experience With:
    • GitHub Actions and Harness
    • Python
    • Google Cloud Platform (GCP): DAGs/Cloud Composer/Airflow, GCS, Cloud Logging Service
    • Release Coordination/Change Management/Deployment Support
    • Access and Entitlement Management

    Good to have knowledge on, but not main requirements:
    • BigQuery
    • Dataproc Serverless
    • Dataflow
    • Spark
    • Beam

    Similar Jobs