GCP Cloud Engineer

TechDigital

  • St. Louis, MO
  • 30+ days ago

    Highlights

    Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging). o Secret Manager• Monitor GCP usage and quotas, and proactively prevent quota-related issues.

    Numbers & Facts

    LocationSt. Louis, MO
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Description

    Mandatory skills: GCP Composer (Apache Airflow)

    Job Description:
    • Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
    • Have Good Understanding of GCP Composer (Apache Airflow) environments.
    • Manage Airflow DAGs and troubleshoot Airflow-related issues.
    • Monitor and optimize Composer performance and scalability.
    • Maintain GCP infrastructure including services like:
    o Google Cloud Storage (GCS)
    o BigQuery (BQ)
    o Cloud Dataflow ( Apache Beam )
    o Cloud Dataproc
    o Cloud Functions
    o Cloud Run
    • Have Good Understanding of:
    o IAM and service account permissions
    o Secret Manager
    • Monitor GCP usage and quotas, and proactively prevent quota-related issues.
    • Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
    • DB design experience (with Excellent RDBS-PLSQL knowledge )
    • Design Springboot APIs
    • Analyze, design, create Dockerfile
    • Knowledge on Angular ( Good to Have )
    • Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
    • Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
    • Ensure security, compliance, and cost-efficiency across the cloud environment.
    • Document system configurations, procedures, and best practices.
    • Proficient in either Java or Python programming languages.
    • Excellent problem-solving and troubleshooting skills.
    • Strong communication and documentation abilities.
    • Knowledge on DNS and SSO configuration setup
    • Knowledge on CDC Pipelines/Application (Good to Have)

    Similar Jobs

    See more jobs