Databricks Solutions Architect
Location: TBD
Job Type: Contract
Position Overview
Our client is seeking an experienced Databricks Solutions Architect to lead the design, architecture, and modernization of its enterprise data platform. This role provides technical leadership for scalable, secure, and governed Databricks solutions, mentors engineering teams, and helps establish architecture standards.
The ideal candidate has extensive hands-on experience designing enterprise-scale Databricks platforms, migrating legacy data environments, and implementing modern lakehouse architectures using Delta Lake, Unity Catalog, Lakeflow, and AI/ML capabilities.
Key Responsibilities
- Serve as technical advisor for Databricks reference architecture, including Lakeflow, Delta Lake, Unity Catalog, Mosaic AI, Databricks SQL, and Databricks Apps
- Design and provide hands-on guidance for end-to-end Databricks data platform solutions
- Architect batch and real-time streaming pipelines, including zero-copy data sharing patterns
- Lead migrations from legacy SQL databases, data warehouses, and document stores to Databricks and cloud data platforms
- Design secure, governed architectures using Unity Catalog, ABAC, governed tags, row- and column-level security, encryption, key management, networking, and compliance frameworks
- Develop multi-tier data lake architectures aligned with data classification and regulatory requirements
- Establish FinOps best practices for workload optimization, performance tuning, and cost management
- Mentor data engineers, analysts, and AI/ML teams; participate in architecture reviews and define technical standards
- Partner with security, infrastructure, and governance teams to ensure policy compliance
- Evaluate emerging Databricks capabilities and recommend adoption strategies and platform enhancements
Required Qualifications
- 7+ years designing, building, and operating enterprise Databricks environments using Medallion Architecture
- Extensive hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or Delta Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
- Strong cloud architecture experience supporting Databricks on AWS (S3, KMS, VPC) and/or Azure (ADLS, VNet), including cloud networking and security
- Proven success migrating enterprise data platforms from legacy or on-prem environments to Databricks
- Experience designing and supporting production streaming and Change Data Capture (CDC) solutions
- Deep understanding of data governance, security, and compliance: Unity Catalog policies (ABAC), data classification, encryption, access auditing, and regulatory compliance
- Experience designing multi-tier Databricks environments based on data classification
- Strong skills in Python, SQL, Apache Spark, and Databricks Notebooks
- Excellent communication, presentation, and stakeholder management skills
Preferred Qualifications
- Active Databricks certifications
- Experience with Generative AI and AI agent development on Databricks
- Knowledge of Delta Sharing, Databricks Clean Rooms, and governed cross-organizational data sharing
- Experience integrating Databricks with major ERP platforms and their native data services, including zero-copy integration patterns
- Experience with Lakeflow Designer, Databricks Apps, Genie, and Databricks One
- CI/CD and Infrastructure-as-Code (Terraform) for data platforms
- Background designing enterprise BI reporting solutions
- Experience with Data Quality and Data Governance initiatives
- Experience in highly regulated industries (e.g., financial services, healthcare, life sciences, energy, or public sector) and associated compliance frameworks
About INSPYR SolutionsTechnology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities.Applicants requiring reasonable accommodation during the application or interview process should contact HR@inspyrsolutions.com
for assistance.
Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions' Privacy Policy and INSPYR Solutions' AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.