Senior Cloud Engineer
Artech LLC
CHARLOTTE, NC
Apply
JOB DETAILS
LOCATION
CHARLOTTE, NC
POSTED
4 days ago
Details:
Senior Cloud Engineer (Software Engineer 3 )
Details:
Location: Charlotte, NC - Hybrid (3 Days onsite & 2 Days remote)
Technologies: Apache Spark, GCP, Python, Microservices (S3)
Key Responsibilities
- Platform Engineering
- Deploy, configure, and maintain OpenShift clusters or GCP projects for Spark workloads
- Support platform capabilities for statistical model execution
- Distributed Data Processing
- Design and implement large-scale data processing workflows using Apache Spark
- Tune Spark jobs using Kubernetes orchestration and auto-scaling
- Application & Tooling
- Build Python/Django services and microservices supporting platform users
- Configure tooling and internal applications for data processing and model execution
- Automation & CI/CD
- Build and maintain CI/CD pipelines using GitHub Actions, Sonar, Harness, Helm
- Monitoring & Troubleshooting
- Monitor Spark jobs and cluster health using Prometheus, Grafana, and GCP tools
- Debug distributed systems and optimize resource utilization
- Security & Compliance
- Implement RBAC and encryption for data in transit and at rest
- Collaboration
- Work closely with cross-functional teams to define requirements and support deployments
Qualifications
- Experience
- 3 years with Apache Spark
- 2 years Django development
- 1 year creating/maintaining conda environments
- 2 years with OpenShift/Kubernetes
- Experience working with GCP or another major cloud provider
- Technical Skills
- Spark frameworks (PySpark, Scala, or Java)
- OpenShift/Kubernetes administration
- Docker container experience
- Python, Scala, or Java programming
- Experience with GitHub Actions, Helm, Harness
- Knowledge of distributed systems and cloud storage (S3, GCS, HDFS)
- Education
- Bachelor’s degree in Computer Science, Engineering, or related field
About the Company
A