AI Quality Engineer

Global Financial Firm located in Irving, TX has an immediate contract opportunity for an experienced AI Quality Engineer

Work Mode: Hybrid

Pay Rate Range: $ 64.00 - $ 68.00 Negotiable based upon years of experience

Responsibilities:

• Design and develop overall quality assurance plans, procedures, and standards specifically tailored for AI/Machine Learning models and systems, including Generative AI solutions and autonomous AI agents.
• Create detailed test strategies and test plans to evaluate the robustness, functionality, performance, and ethical behavior of AI agents and models.
• Develop, implement, and execute a wide range of test cases to validate AI model outputs, decision-making processes, and overall system behavior.
• Verify AI agent robustness against various inputs, edge cases, and unexpected scenarios.
• Design and conduct tests to measure AI model inference speed, resource utilization, and scalability.
• Contribute to ensuring data quality for training and validation, and work with data scientists to design tests for identifying and mitigating model bias and fairness issues.
• Develop and maintain automated testing frameworks and scripts for AI/ML pipelines, model validation, and system integration.
• Identify, document, track, and prioritize defects and inconsistencies in AI model behavior and system functionality.
• Define key quality metrics and provide regular status updates and quality reports to stakeholders.
• Collaborate effectively with data scientists, machine learning engineers, software developers, product managers, and business stakeholders.
• Stay abreast of the latest advancements in AI testing methodologies, tools, and best practices.

Requirements:

• Bachelor's or Master's degree in Computer Science, Software Engineering, Quality Assurance, or a related technical field.
• Minimum 3 years of experience in Quality Assurance or Software Testing, with at least 1-2 years focused on AI/Machine Learning systems.
• Strong understanding of AI/ML concepts, including supervised, unsupervised, and reinforcement learning.
• Experience in designing and developing test strategies, test plans, and test cases for complex software systems involving AI components.
• Proficiency in at least one programming language (Python strongly preferred) for test automation and data analysis.
• Familiarity with AI/ML frameworks (e.g., TensorFlow, PyTorch) and relevant testing libraries.
• Experience with various testing methodologies and tools.
• Excellent analytical skills and attention to detail.
• Strong communication and collaboration skills.