Amazon logo

Software Development Engineer Test, Alexa Global quality

Amazon

  • Bellevue, WA
  • 30+ days ago

    Highlights

    Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales * Working closely with engineers to architect and develop the best technical design and testing approach for internationalization (i18n) * Building and evolving agentic tooling for end-to-end quality evaluation - from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment * Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market * Working effectively with product managers, Country PMs, designers, engineering, locale experts, and business teams to deliver the best overall experience factoring in financial goals, usability goals, and locale-specific customer expectations Key job responsibilities - This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa's multi-locale experience. We are solving hard challenges in validation across speech, visual, conversational quality, locale cultural, and linguistic dimensions - building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning.

    Numbers & Facts

    LocationBellevue, WA
    IndustryOther/Not Classified
    Company Size10,000 employees or more
    Year Founded1994
    Websitehttp://Amazon.com/militaryroles

    Description

    Description Come join us to launch Alexa+ globally to millions of customers across 100+ countries, solving hard challenges in multilingual, conversational CX evaluation across multimodal experiences spanning text, voice, and visual across many device surfaces. We are solving hard challenges in validation across speech, visual, conversational quality, locale cultural, and linguistic dimensions - building agentic automation tooling that spans the full quality spectrum from synthetic test generation, to LLM-as-a-Judge evaluation, to visual validation using AI, to cultural relevancy classification powered by machine learning. The Alexa Global Quality (AGQ) team is responsible for ensuring Alexa delivers a high-quality, culturally relevant experience to customers across multiple international locales. We are building a scalable, AI-powered automation solution for multi-locale and linguistic product validation - one that can efficiently scale across all supported locales while maintaining the cultural and linguistic nuances that matter to our diverse customer base. * This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa's multi-locale experience. We are looking for a proven, hands-on, results-oriented quality assurance software engineer to drive the strategy, tool selection, quality bar, and best practices for the future experience of our international customers. * Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales * Working closely with engineers to architect and develop the best technical design and testing approach for internationalization (i18n) * Building and evolving agentic tooling for end-to-end quality evaluation - from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment * Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market * Working effectively with product managers, Country PMs, designers, engineering, locale experts, and business teams to deliver the best overall experience factoring in financial goals, usability goals, and locale-specific customer expectations Key job responsibilities - This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa's multi-locale experience. We are looking for a proven, hands-on, results-oriented quality assurance software engineer to drive the strategy, tool selection, quality bar, and best practices for the future experience of our international customers. - Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales - Working closely with engineers to architect and develop the best technical design and testing approach for internationalization (i18n) - Building and evolving agentic tooling for end-to-end quality evaluation - from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment - Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market - Working effectively with product managers, Country PMs, designers, engineering, locale experts, and business teams to deliver the best overall experience factoring in financial goals, usability goals, and locale-specific customer expectations Basic Qualifications - 4+ years of non-internship professional software development testing experience - 2+ years of test automation frameworks and tools building experience - Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design - Experience in penetration testing and exploitability-focused vulnerability assessment - Experience in platform-level security mitigations and hardening for Linux and Windows Preferred Qualifications - Knowledge of overall system architecture, scalability, reliability, and performance in a database environment - Experience building test automation frameworks and tools Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, WA, Bellevue - 143,700.00 - 194,400.00 USD annually

    About Company

    At Amazon, we don’t wait for the next big idea to present itself. We envision the shape of impossible things and then we boldly make them reality. So far, this mindset has helped us achieve some incredible things. Let’s build new systems, challenge the status quo, and design the world we want to live in. We believe the work you do here will be the best work of your life.

    Wherever you are in your career exploration, Amazon likely has an opportunity for you. Our research scientists and engineers shape the future of natural language understanding with Alexa. Fulfillment center associates around the globe send customer orders from our warehouses to doorsteps. Product managers set feature requirements, strategy, and marketing messages for brand new customer experiences. And as we grow, we’ll add jobs that haven’t been invented yet.

    It’s Always Day 1
    At Amazon, it’s always “Day 1.” Now, what does this mean and why does it matter? It means that our approach remains the same as it was on Amazon’s very first day – to make smart, fast decisions, stay nimble, invent, and stay focused on delighting our customers. In our 2016 shareholder letter, Amazon CEO Jeff Bezos shared his thoughts on how to keep up a Day 1 company mindset. “Staying in Day 1 requires you to experiment patiently, accept failures, plant seeds, protect saplings, and double down when you see customer delight,” he wrote. “A customer-obsessed culture best creates the conditions where all of that can happen.” You can read the full letter here

    Our Leadership Principles
    Our Leadership Principles help us keep a Day 1 mentality. They aren’t just a pretty inspirational wall hanging. Amazonians use them, every day, whether they’re discussing ideas for new projects, deciding on the best solution for a customer’s problem, or interviewing candidates. To read through our Leadership Principles from Customer Obsession to Bias for Action, visit https://www.amazon.jobs/principles

    Similar Jobs

    See more jobs