Senior Consultant

Contribute to data governance and quality initiatives, including data catalog migration, DQ framework adoption, and testing best practices across the Databricks ecosystem. Test and verify Delta Sharing, Unity Catalog, role-based access controls, and data security mechanisms to ensure secure data access and governance.

Our client, a IT Services and Consulting company, is looking for a Senior Consultant for their New York, NY/ Manhattan, NY/ Hybrid/ Remote location.
 
Responsibilities:

• Develop and execute test plans, test cases, and validation strategies for data projects built on Databricks, AWS, and Delta Sharing platforms.
• Validate data ingestion pipelines, data transformations, and Medallion Architecture layers to ensure data quality, accuracy, completeness, and performance.
• Create and maintain automated data testing frameworks using SQL and automation tools to support repeatable regression testing.
• Test and verify Delta Sharing, Unity Catalog, role-based access controls, and data security mechanisms to ensure secure data access and governance.
• Collaborate with Development, Product Owners, and Data Engineering teams to identify defects, track quality metrics, and resolve testing issues.
• Support release planning, deployment validation, and production deployments while providing clear communication on testing status, risks, and issues.
• Contribute to data governance and quality initiatives, including data catalog migration, DQ framework adoption, and testing best practices across the Databricks ecosystem.

 
Requirements:

• Years of experience required: 6-9

Mandatory skills:

• Databricks
• AWS
• Delta Sharing

Skills:

• Category                      Name                           Required          Importance      Experience
• AIA_NEW                    Delta Sharing                Yes                  1
• Data Management         Databricks                    Yes                  1
• IIOT (Industrial IOT)    AWS                            Yes                  1

 
Why Should You Apply?

• Health Benefits
• Referral Program
• Excellent growth and advancement opportunities