Sign upLog in
See more jobs

Senior Python Platform Engineer – GCP

Tech3pillars Technologies

  • NULL, NC
  • 2 days ago

    Highlights

    The ideal candidate will have strong experience developing production-grade APIs in Python, working with data frameworks and pipeline orchestration systems, and deploying containerized services using Docker/Kubernetes . We are seeking an experienced Python Platform Engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark/PySpark through well-defined API contracts.

    Numbers & Facts

    LocationNULL, NC

    Description

    Senior Python Platform Engineer GCP

    Location: Charlotte, NC 28202
    Work Model: Hybrid
    Experience: 10+ Years

    Job Summary

    We are seeking an experienced Python Platform Engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark/PySpark through well-defined API contracts.

    The role focuses on building scalable platform capabilities and reusable services, rather than simply consuming existing data tools. The ideal candidate will have strong experience developing production-grade APIs in Python, working with data frameworks and pipeline orchestration systems, and deploying containerized services using Docker/Kubernetes.

    The candidate should also have strong GCP experience, excellent client communication skills, and the ability to coordinate onsite and offshore development teams.

    Must-Have Skills

    • Python
    • PySpark
    • API Development
    • Microservices
    • CI/CD
    • GCP
    • ETL
    • FastAPI
    • Kubernetes
    • Docker
    • Pytest

    Technical Skills

    • 10+ years of IT/software engineering experience
    • Strong hands-on experience with Python-based platform engineering
    • Experience building production-grade APIs using FastAPI
    • Strong knowledge of PySpark/Apache Spark
    • Experience designing and developing microservices
    • Experience building control planes/platform services
    • Strong understanding of software design patterns
    • Experience with containerized services using Docker and Kubernetes
    • Hands-on experience with GCP
    • Experience implementing CI/CD pipelines, preferably using GitHub Actions
    • Strong knowledge of functional and behavioral testing
    • Experience with Pytest

    Platform & Design Patterns

    Experience with the following concepts is highly desirable:

    • Modular containerized services
    • Asynchronous processing
    • Job-based work queue execution
    • Immutability and idempotency
    • Metadata management
    • Policy enforcement
    • Semantic modeling
    • Observability and telemetry
    • Side-effect capability injection
    • API contract design and versioning
    • Reusable platform services

    Frameworks & Platforms

    • Python
    • FastAPI
    • ARQ
    • PySpark
    • Kubernetes
    • Docker
    • GCP
    • Pytest
    • GitHub Actions

    Similar Jobs