Amazon.com Inc logo

Software Development Engineer, Alexa Excellence, Alexa LLM Inference, Capacity, & Efficiency

Amazon.com Inc

  • Bellevue, WA
  • 9 days ago

    Highlights

    We build products and solutions that enable Alexa service owners to analyze, forecast, and manage LLM infrastructure drivers, costs, and usage and inferences at large scale. The Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team is looking for Software Development Engineers to join our Inferences Services Team.

    Numbers & Facts

    LocationBellevue, WA
    IndustryRetail
    Company Size10,000 employees or more
    Year Founded1994
    Websitehttp://Amazon.com/militaryroles

    Description

    Are you passionate about building infrastructure that powers AI at scale? Do you want to work on systems that serve millions of Alexa customers every day? The Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team is looking for Software Development Engineers to join our Inferences Services Team.

    We build products and solutions that enable Alexa service owners to analyze, forecast, and manage LLM infrastructure drivers, costs, and usage and inferences at large scale. You will be working on high-visibility, high-impact systems that are critical to the success of Alexa"s next generation of AI experiences.

    Key job responsibilities

    • Design, develop, and maintain large-scale distributed systems and infrastructure services, leveraging GenAI at all phases of the development cycle
    • Work on GPU fleet management and optimization for low-latency machine learning inference workloads at very large scale
    • Collaborate with senior engineers/scientists to deliver features from design through production deployment
    • Set standards and contribute to the operational excellence of Tier-1 production services
    • Write clean, testable, maintainable code and participate actively in code reviews
    • Work closely with partner teams across Alexa and AWS(Bedrock etc) to deliver cross-functional projects
    • Research and identify opportunities to improve service performance, reliability, and cost efficiency

    About Company

    At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.

    Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.

    It’s Always Day 1
    At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here

    Our Leadership Principles
    Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles

    Similar Jobs

    See more jobs