Highlights
We are seeking an experienced Test Automation Engineer with strong hands-on expertise in Python, Generative AI (GenAI), Large Language Models (LLMs), Playwright, and MCP (Model Context Protocol). The ideal candidate will have a strong background in test automation and practical experience applying AI and LLM technologies to modern software testing.
Numbers & Facts
| Location | Phoenix, AZ |
| Job Type | Contractor, Full-time |
| Salary | $70,000–$75,000 Per Year |
| Company Size | 201 - 500 |
| Headquarters | Livonia, MI, US |
| Website | https://plugins-inc.com/ |
Description
Job Title: Test Automation Engineer – Python + GenAI + LLMs
Location: Phoenix, AZ – Day 1 Onsite / Hybrid
Experience: 5+ Years
Employment Type: Full-Time
Onsite Requirement: Candidates must be willing to work onsite in Phoenix from Day 1.
JOB DESCRIPTION
We are seeking an experienced Test Automation Engineer with strong hands-on expertise in Python, Generative AI (GenAI), Large Language Models (LLMs), Playwright, and MCP (Model Context Protocol).
The ideal candidate will have a strong background in test automation and practical experience applying AI and LLM technologies to modern software testing. Python-only automation experience is not sufficient for this position. Hands-on GenAI and LLM experience is mandatory.
Job Responsibilities
KEY RESPONSIBILITIES
· Design, develop, and maintain scalable test automation frameworks using Python, Playwright, and MCP.
· Integrate and validate LLM and GenAI technologies within test automation workflows.
· Develop AI-assisted solutions for test case generation, test data generation, and automation improvements.
· Implement BDD testing approaches using Cucumber/Gherkin where applicable.
· Develop and execute automated UI, API, and end-to-end test scenarios.
· Execute and manage automated test suites using TestNG and TestX.
· Analyze test results and troubleshoot automation failures.
· Identify root causes and provide recommendations for improving application quality.
· Log, track, and support resolution of software defects.
· Collaborate with developers, QA engineers, product teams, and other stakeholders in an Agile environment.
· Identify opportunities to improve test coverage, automation efficiency, and overall software quality.
· Support AI-driven and next-generation quality engineering initiatives.
Qualifications
REQUIRED SKILLS AND QUALIFICATIONS
· 5+ years of experience in software testing and test automation.
· Strong hands-on experience with Python.
· Hands-on experience with Generative AI (GenAI).
· Strong knowledge and practical experience with Large Language Models (LLMs).
· Experience with LLM prompting, RAG, AI-assisted test generation, or related GenAI applications.
· Hands-on experience with Playwright for UI and/or API automation.
· Knowledge or hands-on experience with MCP (Model Context Protocol).
· Experience with BDD frameworks such as Cucumber and Gherkin.
· Experience with TestNG.
· Experience with TestX.
· Working knowledge of Java.
· Strong understanding of software testing methodologies and automation best practices.
MUST-HAVE SKILLS
Python | GenAI | LLMs | Playwright | MCP | BDD | TestNG | TestX | Java
IMPORTANT:
· Candidates must have meaningful experience with both GenAI and LLM technologies in addition to Python-based test automation.
· Candidates with Python automation experience alone will not be considered.
GOOD TO HAVE
· Experience with AI-driven testing tools and quality engineering solutions.
· Experience with CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.
· Experience with Docker.
· Experience with AWS or Azure cloud platforms.
· Experience working in Agile/Scrum environments.