Software Engineer AI/ML QA Engineer

The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills. Key Responsibilities: Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.

Company Description 
Lumen Solutions Group Inc. is a technology consulting Services company based in Florida. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and Enterprise Transformation. 
 
Role: Software Engineer – AI/ML QA Engineer
Location: Columbia, MD / Washington, DC (Hybrid – Required once in a Week)
Job Type: 6 Months Contract (Possible Extension)
 
Job Summary:
We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills.


Key Responsibilities:

• Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.
• Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
• Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
• Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
• Test Salesforce Einstein and integrations with external LLM/AI platforms.
• Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
• Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety.
• Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
• Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
• Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.

 
Required Qualifications

• 3+ years of Software Engineering experience.
• 1–2 years of hands-on AI/ML/Generative AI project experience.
• 3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
• Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
• Strong hands-on experience with Selenium, BDD, and test automation.
• Experience with API, UI, manual, and automation testing.
• Strong SQL skills and experience with Oracle.
• Understanding of relational and non-relational databases.
• Understanding of data pipelines and ability to validate intermediate pipeline outputs.
• Experience working with Jira and Confluence.
• Bachelor's degree required; technical degree preferred.

 
Nice to Have

• Experience with AWS Bedrock and/or SageMaker.
• Experience with AI/ML testing frameworks.

 
Lumen Solutions Group Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.