Technical Architect - I_Azure DataBricks

VeeRteq Solutions Inc.

  • Irving, TX
  • 5 days ago
  • Remote

    Highlights

    Databricks Lakehouse Architecture Lead Databricks Lakehouse solution using Delta Lake, Lakeflow Jobs, Delta Live Tables or equivalent pipeline patterns, Databricks SQL, Unity Catalog, Data Quality, Lineage, and Governance . Strong hands on architecture experience with Azure Databricks, DBT, SQL Server Stored Procedures, SSIS, Delta Lake, Databricks SQL, Unity Catalog, and Medallion Architecture .

    Numbers & Facts

    LocationIrving, TX (
    Remote
    )

    Description

    Role: Technical Architect - I_Azure DataBricks
      Key Responsibilities Discovery, Architecture and Solution Design

      Lead discovery and architecture discussions with customer stakeholders

      Validate current state architecture, data flow, existing business logic, source dependencies, data gaps, and reporting consumption patterns

      Databricks Lakehouse Architecture

      Lead Databricks Lakehouse solution using Delta Lake, Lakeflow Jobs, Delta Live Tables or equivalent pipeline patterns, Databricks SQL, Unity Catalog, Data Quality, Lineage, and Governance

      Define ingestion, transformation, data quality, orchestration, audit, logging, and monitoring patterns across layers

      Guide the use of metadata driven ingestion and processing frameworks for repeatable ingestion, configuration driven pipelines, auditability, and operational consistency

      Define standards for catalog, schema, table, view, workflow, job, and configuration management across Dev, QA, and Prod

      Provide architecture guidance for performance, scalability, partitioning and clustering, workload sizing, and operational readiness

      Governance, Security and Observability

      Define the use of Unity Catalog for access control, catalog and schema governance, lineage where available, technical metadata, and data security

      Collaborate with customer security teams to align Databricks roles, privileges, sensitive data handling, and masking rules

      Define an observability approach for pipeline health, data quality status, freshness, job failures, operational metrics, and cost monitoring

      Ensure compliance and audit requirements are considered in the solution architecture

      Validation, Reconciliation and Customer Engagement

      Support customer alignment on validation criteria, historical load expectations, KPI level reconciliation, and business sign off approach

      Lead solution review discussions, explain technical trade offs, and help manage scope clarifications

      Provide advisory support during estimation, roadmap refinement, and schedule compression discussions

      Required Skills and Qualifications

      10+ years of experience in data architecture, cloud data platforms, healthcare analytics, data modernization, or enterprise data engineering

      Strong hands on architecture experience with Azure Databricks, DBT, SQL Server Stored Procedures, SSIS, Delta Lake, Databricks SQL, Unity Catalog, and Medallion Architecture

      Strong understanding of the Azure ecosystem, including ADLS, ADF and orchestration patterns, GitHub, GitHub Actions, Azure networking, identity, and security concepts

      Proven experience designing Bronze, Silver, Gold, and Semantic or Consumption layers for analytics use cases

      Ability to define and communicate solution architecture to both executive and technical stakeholders

      Strong experience in requirements clarification, scope definition, assumptions and dependencies documentation, and delivery planning

      Excellent communication, facilitation, and stakeholder management skills in an onshore client facing role

      Mandatory Skills

      Azure Databricks, DBT, SSIS, and SQL Server Stored Procedure architecture and implementation experience

      Databricks Medallion Architecture, including Bronze, Silver, Gold, and Semantic or Metric layers

      Delta Lake, Databricks SQL, Lakeflow Jobs and Workflows, and Databricks job orchestration

      Unity Catalog governance, access control, lineage, and data security concepts

      Azure Data Platform experience including ADLS, ADF and ingestion patterns, Azure SQL, and SQL Server

      Experience defining Data Quality, Reconciliation, Audit, Logging, and Operational Monitoring patterns

      CI/CD experience for data platform deployments

      Client facing consulting experience with the ability to conduct workshops, solution walkthroughs, and design reviews

      Ability to manage scope, risks, assumptions, dependencies, and architectural decisions

      VeeRteq Solutions is an Equal Opportunity Employer

      Similar Jobs