Amazon.com Inc logo

Software Development Engineer (Elastic Kubernetes Service), EKS Scalability & Performance

Amazon.com Inc

  • Seattle, WA
  • 30+ days ago

    Highlights

    You will build and operate the Vertical Auto-Scaling Service (VAS) and its next-generation successor (VAS 2.0), which dynamically right-sizes EKS control planes by evaluating CPU/memory utilization, etcd throttle rates, node-count thresholds, and network utilization simultaneously. The EKS KCP Scalability organization owns the performance, availability, and autoscaling of the Kubernetes control plane powering Amazon EKS - from small development clusters to 100,000-node Ultraclusters running generative AI workloads.

    Numbers & Facts

    LocationSeattle, WA
    IndustryRetail
    Company Size10,000 employees or more
    Year Founded1994
    Websitehttp://Amazon.com/militaryroles

    Description

    We are looking for a Software Development Engineer to join the EKS KCP Scalability team and work on some of the hardest distributed systems problems at Amazon. You will design, build, and operate systems that directly determine whether EKS customers - from startups to the largest AI/ML workloads on the planet - experience a reliable, performant control plane.

    This is not a role where you implement features in isolation. You will work across the full stack: from the Kubernetes API server process and upstream community engagement, through autoscaling services that right-size control planes in real time, to the SLA measurement pipelines that hold us accountable to our customers. You will own systems end-to-end - from design through production operations - and your work will be measured by customer outcomes, not lines of code.

    Key job responsibilities

    You will build and operate the Vertical Auto-Scaling Service (VAS) and its next-generation successor (VAS 2.0), which dynamically right-sizes EKS control planes by evaluating CPU/memory utilization, etcd throttle rates, node-count thresholds, and network utilization simultaneously. You will work on the SLA measurement pipeline (MinutelySLA DailySLA MonthlySLA) that enforces EKS"s uptime commitments, investigating breaching clusters weekly and building automation to detect and mitigate degradation before customers notice.

    You will contribute to the control plane architecture for EKS Ultraclusters, defining how the API server, etcd, and associated components scale to support 100,000-node clusters running generative AI workloads. You will maintain and extend version release qualification scale tests that gate every new Kubernetes version before it reaches customers. You will engage with the upstream Kubernetes community - driving KEPs that work backwards from EKS customer requirements around performance, scale, and resiliency.

    Depending on your interests and the team"s priorities, you may also work on workload identity systems (IRSA, EKS Pod Identity), Cluster Access Management, EC2 capacity management and grey failure detection, or Large-Scale Event response and weight shifting.

    About the team

    The EKS KCP Scalability organization owns the performance, availability, and autoscaling of the Kubernetes control plane powering Amazon EKS - from small development clusters to 100,000-node Ultraclusters running generative AI workloads. We ensure every EKS cluster operates within its contracted SLA and delivers predictable, high-performance behavior at any scale.

    Our charter spans three domains: Performance , Availability + Autoscaling , and Auth. We operate at the intersection of distributed systems, Kubernetes internals, and AWS infrastructure - building systems that scale to hundreds of thousands of clusters globally.

    About Company

    At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.

    Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.

    It’s Always Day 1
    At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here

    Our Leadership Principles
    Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles

    Similar Jobs

    See more jobs