a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
Senior QA Lead ETL, Databricks & Agentic AI Testing
Location: Chicago, IL (Hybrid - 3 days onsite)
Duration: Contract
Experience: 10+ Years
Key Skills
- ETL & Data Testing
- Advanced SQL
- Azure Databricks / PySpark
- Agentic AI / GenAI Testing & Evaluation
- Web Testing
- Test Automation Tools (pytest, Great Expectations, dbt, etc.)
- Python Automation
- Azure Boards
Responsibilities
- Define QA strategy, test plans, and reconciliation framework for large-scale data migration programs.
- Validate source-to-target data across ETL pipelines and Databricks environments.
- Build automated regression and data quality validation frameworks.
- Evaluate AI/LLM-generated queries and transformation logic using MLflow or similar tools.
- Ensure data integrity, compliance, security, and multi-tenant data isolation.
- Lead QA efforts, mentor engineers, manage defects, and provide executive-level reporting.
Required Experience
- 10+ years in ETL/Data Testing with ownership of test strategy.
- Strong SQL, Databricks/PySpark, and Python automation expertise.
- Experience with data reconciliation, migration validation, and test automation frameworks.
- Exposure to healthcare data, PHI compliance, and large-scale data platforms.
- Experience validating AI/Agentic systems is highly preferred.
Ideal Candidate: Senior QA professional with strong Data Testing, Databricks, SQL, Automation, and Agentic AI evaluation experience who can drive quality strategy and scalable validation across complex data platforms.