Platform Engineer VI – Data Services
Location: Denver, CO – Onsite
Local candidates only
Job Summary
We are seeking a highly experienced Platform Engineer VI – Data Services to serve as a senior platform engineering lead supporting data platforms, AI/agent infrastructure, production operations, and automation.
The ideal candidate will have strong expertise in AWS, Terraform, Python, data pipelines, monitoring, containerization, CI/CD, and Linux, along with the ability to make independent technical decisions and lead engineering teams across time zones.
Key Responsibilities
Production Support & Operations
- Own production support for infrastructure, data pipelines, and AI/agent platforms.
- Monitor pipeline health, data freshness, infrastructure availability, and system performance.
- Triage and resolve production incidents independently.
- Maintain monitoring dashboards, alerts, and operational processes.
Cloud & Cost Optimization
- Manage and optimize AWS infrastructure across compute, storage, networking, and related services.
- Monitor AWS infrastructure and AI/compute costs and identify optimization opportunities.
- Develop cost dashboards and support capacity and cost modeling initiatives.
- Right-size infrastructure based on usage patterns and performance requirements.
Data Pipeline & Platform Engineering
- Monitor data availability, freshness, quality, and pipeline performance.
- Support pipeline recovery, backfills, and troubleshooting.
- Work with data engineering teams to establish health checks and SLA monitoring.
- Support batch and streaming data pipeline architectures.
Application Development & Automation
- Develop Python-based scripts, CLIs, services, and automation utilities.
- Build integration services connecting data platforms with upstream and downstream systems.
- Develop solutions using REST APIs and AWS SDKs such as boto3.
- Create automated tests for application and infrastructure code.
Leadership
- Lead and mentor platform engineering teams.
- Establish runbooks, escalation procedures, and operational standards.
- Coordinate effectively with engineering, data, and data science teams.
- Participate in architecture and infrastructure design decisions.
Required Skills
- Expert experience with AWS, including:
- EC2
- S3
- IAM
- VPC
- Glue
- Athena
- EMR
- Secrets Manager
- CloudWatch
- Strong Terraform experience; CloudFormation is acceptable.
- Strong production monitoring, alerting, and incident response experience.
- Experience with AWS cost monitoring and optimization.
- Experience with Docker and CI/CD pipelines.
- Strong Linux and shell scripting skills.
- Proficiency in Python or a comparable programming language.
- Strong software engineering fundamentals including Git, code reviews, modular design, dependency management, and maintainable code.
- Experience writing unit and integration tests and integrating them into CI/CD.
- Experience developing integrations using REST APIs and AWS SDKs.
- Strong understanding of batch and streaming data pipelines.
- Experience leading and mentoring engineering teams.
- Ability to make independent technical decisions and troubleshoot production issues.
Preferred Skills
- Apache Spark, preferably Scala.
- Apache Kafka or similar streaming technologies.
- Airflow or similar workflow orchestration platforms.
- Graph databases such as AWS Neptune or Neo4j.
- AI/ML infrastructure and model-serving environments.
- LLM/AI agent deployment infrastructure and observability.
- Telecommunications or large-scale network operations experience.
- FastAPI, Flask, or similar production API frameworks.
- AWS certifications such as Solutions Architect or DevOps Engineer.
Education & Experience
- Bachelor's degree in Computer Science, Information Technology, Systems Engineering, or a related field, or equivalent experience.
- 8+ years of platform/infrastructure engineering experience with a bachelor's degree, including 2+ years in a lead or senior role.
- With a master's degree, 6+ years of platform/infrastructure engineering experience, including 2+ years in a lead or senior role.