Location
London

Hours
Full Time

Salary
Competitive, commensurate with experience

About the Role
This role requires fluency (speaking, reading, and writing) in one or more European languages - preferably French or German - as you'll drive quality across Alexa+'s multilingual experience in over 100 countries. Join us to launch Alexa+ globally to millions of customers, solving complex challenges in multilingual conversational customer experience evaluation across text, voice, and visual modalities on multiple device surfaces. You will tackle validation challenges spanning speech, visual, conversational quality, cultural, and linguistic dimensions by building advanced automation tooling that covers synthetic test generation, LLM-as-a-Judge evaluation, AI-powered visual validation, and machine learning-driven cultural relevancy classification.

As a Sr. Quality Assurance Engineer in the Alexa Global Quality (AGQ) team, you will own the end-to-end quality of Alexa+, ensuring millions of customers receive a culturally relevant, high-quality experience across voice, text, and visual modalities. You will define global test strategies, architect AI-powered evaluation frameworks, and shape how quality is measured across multiple features, endpoints, and languages.

Your responsibilities include defining and driving global test approaches for Alexa's multi-locale experience, collaborating closely with engineers to design and implement internationalization testing strategies, and evolving agentic quality evaluation frameworks. You will execute both strategic and hands-on testing, running end-to-end test suites autonomously and manually, monitoring production trends, and taking decisive actions to improve customer experience.

You will create metrics and reports on quality status, technical operations, and system performance across all locales, driving towards consistent yet culturally appropriate quality standards. Additionally, you will develop automation and quality tooling to improve test efficiency across a global organization and collaborate effectively with product managers, locale experts, designers, engineering, and business teams to deliver the best overall experience while considering financial goals, usability targets, and locale-specific customer expectations.

A typical day involves reviewing automated test results across multiple locales, triaging quality signals from production, collaborating with engineers and locale experts to resolve issues, refining evaluation frameworks, and driving tooling improvements while performing hands-on testing of new Alexa+ features before global release.

The Alexa Global Quality team combines deep linguistic expertise with niche AI-powered evaluation to scale quality rapidly. Our culture values ownership, curiosity, and a passion for delighting customers across cultures and languages.

Experience
- Proven knowledge of QA methodology and tools with demonstrated experience in a Quality Assurance Engineer role
- Experience delivering test frameworks, test tools, and leading QA projects and initiatives
- Experience in both automation and manual testing
- Experience working with Linux operating systems, embedded systems, consumer devices, or mobile applications
- Skilled in programmatic product testing, measuring test coverage, developing automation, and driving testability and diagnostics

About you
- Fluent in speaking, reading, and writing in one or more European languages, preferably French or German (also Dutch, Polish, Turkish, Portuguese considered)
- Strong collaborator able to work effectively with product managers, engineers, locale experts, and business teams
- Passionate about delivering culturally relevant, high-quality multilingual customer experiences
- Self-motivated with a balance of strategic thinking and hands-on execution

Qualifications
- Knowledge of at least one modern object-oriented programming language such as C++, Java, or Objective C
- Experience in UI automation, preferably on mobile platforms
- Demonstrated ability to architect AI-powered evaluation frameworks and drive quality innovation