Big Data Architect

In this key Software Engineer role, you'll be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow, keeping critical processes flowing as smoothly as a well-timed morning coffee. You'll get to collaborate with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready, delivering results with the consistency of a favorite espresso order.

Perks and Benefits

• 100% Paid Healthcare
• 10% 401k in every paycheck
• 100% Fully Vested!

NOTE – Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.

What You’ll Be Doing (We don’t love the bullet points, but we love the work!)

In this key Software Engineer role, you'll be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow, keeping critical processes flowing as smoothly as a well-timed morning coffee. This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases, because no one wants a pipeline that is more decaf than dependable. You'll get to collaborate with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready, delivering results with the consistency of a favorite espresso order.

Required Skills

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience using Distributed Big Data processing engines including Apache Spark
• Experience with containerization technologies such as Docker, containerd, and Podman
• Experience with Git Source Control System 

Required Skills

• Familiar with AWS Cloud Services and Infrastructure
• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Fluent in sarcasm, kindness, and the occasional office banter

Powered by JazzHR