Elastic Data Engineer

Develop and manage data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including pipelines, Kibana dashboards, and frontend components (React, JavaScript, HTML). Primary Responsibilities Design, build, and maintain scalable data pipelines and systems to ingest, process, and transform large, complex datasets from multiple sources.

Data Engineer / Software Developer

Primary Responsibilities

• Design, build, and maintain scalable data pipelines and systems to ingest, process, and transform large, complex datasets from multiple sources.
• Integrate and unify data from various network operations systems into a consistent, high-quality platform compliant with DoD and DISA standards.
• Develop and manage data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including pipelines, Kibana dashboards, and frontend components (React, JavaScript, HTML).
• Build and optimize data warehouses, data lakes, and analytics platforms for performance, scalability, and cost efficiency.
• Automate ETL/ELT processes, data validation, monitoring, and CI/CD pipelines.
• Continuously optimize ingestion throughput, query performance, indexing, and storage across Kafka and Elastic platforms.
• Collaborate with analysts and stakeholders to deliver actionable data solutions and maintain technical documentation.
• Troubleshoot and resolve data ingestion, processing, and platform performance issues.

Preferred Qualifications

• Experience in DISA/DISN or DoD environments with strong knowledge of DoD security standards (STIGs), encryption, and classified network controls.
• Hands-on expertise with big data tools: Kafka, Spark, Elasticsearch, Logstash, NiFi, and the ELK Stack.
• Cloud experience (AWS, Azure, GCP, AWS GovCloud) including IaC and cloud security policies.
• Proficiency with Kubernetes, configuration management (Ansible, etc.), and observability tools (Prometheus, Grafana).
• Experience with Kibana dashboards and technical documentation.
• Strong Agile background (Scrum/SAFe, JIRA, Confluence).
• Preferred certifications: Certified Confluent Developer and Certified Elastic Engineer.
• Excellent communication skills with experience working in remote, matrixed teams.