Senior Cloud Engineer
Artech LLC
CHARLOTTE, NC
Apply
JOB DETAILS
LOCATION
CHARLOTTE, NC
POSTED
4 days ago
Details:
Software Engineer 3
Details:
Location: Charlotte, NC - Hybrid (3 Days onsite & 2 Days remote)
Key Responsibilities
- Platform Engineering:
- Deploy, configure, and maintain OpenShift clusters or GCP projects for Spark workloads
- Support platform capabilities for statistical model execution
- Distributed Data Processing:
- Design and implement large-scale data processing workflows using Apache Spark
- Tune Spark jobs using Kubernetes orchestration and auto-scaling
- Application & Tooling:
- Build Python/Django services and microservices supporting platform users
- Configure tooling and internal applications for data processing and model execution
- Automation & CI/CD:
- Build and maintain CI/CD pipelines using GitHub Actions, Sonar, Harness, Helm
- Monitoring & Troubleshooting:
- Monitor Spark jobs and cluster health using Prometheus, Grafana, and GCP tools
- Debug distributed systems and optimize resource utilization
- Security & Compliance:
- Implement RBAC and encryption for data in transit and at rest
- Collaboration:
- Work closely with cross-functional teams to define requirements and support deployments
Qualifications
- Experience:
- 3 years with Apache Spark
- 2 years Django development
- 1 year creating/maintaining conda environments
- 2 years with OpenShift/Kubernetes
- Experience working with GCP or another major cloud provider
- Technical Skills:
- Spark frameworks (PySpark, Scala, or Java)
- OpenShift/Kubernetes administration
- Docker container experience
- Python, Scala, or Java programming
- Experience with GitHub Actions, Helm, Harness
- Knowledge of distributed systems and cloud storage (S3, GCS, HDFS)
- Education:
- Bachelor’s degree in Computer Science, Engineering, or related field
About the Company
A