Data Tech Lead

Shiftcode Analytics, Inc

  • Houston, TX
  • 30+ days ago

    Highlights

    Build and optimise AI-augmented data pipelines using: Azure Data Factory (ADF), ADLS, Databricks, Delta Live Tables, Structured Streaming. We're looking for a Data Tech Lead to drive end-to-end delivery across architecture, engineering, governance, and capability development.

    Numbers & Facts

    LocationHouston, TX

    Description

    Data Tech Lead
    6-Month Contract
    Visa : USC and GC
    Location : Houston, TX (hybrid, local or at 50 miles distance)
    UPS (United Parcel services)

    Note : Updated LinkedIn and recent short projects

    Are you ready to take ownership of building cutting-edge data ecosystems and leading high-performing teams? We're looking for a Data Tech Lead to drive end-to-end delivery across architecture, engineering, governance, and capability development.

    This is a strategic leadership role where you'll shape the future of data platforms and enable data-driven innovation at scale.


    What You'll Do
    Lead the architecture, design, and delivery of modern data platforms across cloud and on-prem environments
    Build scalable, high-performance data solutions that unlock business value
    Drive data governance, metadata management, and data modelling best practices
    Partner with cross-functional teams to deliver end-to-end data initiatives
    Champion cost optimisation, performance tuning, and agile delivery
    Engage senior stakeholders, influence decisions, and represent data strategy with clarity


    Key Responsibilities

    Leadership & Strategy
    Define and deliver data product roadmaps aligned to business goals
    Provide technical leadership, ensuring adherence to best practices and standards
    Drive long-term data engineering and architecture strategy

    Technical Oversight
    Lead data architecture and modelling (e.g. SAP PowerDesigner, BiZ Design)
    Build and optimise AI-augmented data pipelines using:
    Azure Data Factory (ADF), ADLS, Databricks, Delta Live Tables, Structured Streaming
    Design robust OLTP systems (schema design, indexing, performance tuning)
    Work across PostgreSQL, MySQL, SQL Server
    Implement governance, security, and lineage using Unity Catalog
    Troubleshoot pipelines and enforce data quality and SLAs

    Governance & Quality
    Establish frameworks for data security, privacy, and lifecycle management
    Drive CI/CD and automated deployment practices
    Monitor and optimise pipeline performance

    Stakeholder Management
    Collaborate with Product Managers, Business Analysts, Data Scientists, and Architects
    Translate complex technical concepts into clear business outcomes
    Build alignment and resolve challenges across stakeholders


    Skills & Experience

    Technical Expertise
    12–17 years in data engineering, architecture, or analytics platforms
    Deep experience with:
    Azure (ADF, ADLS, Databricks, DLT, Azure Functions, Logic Apps)
    SQL, Python, Spark / Scala

    REST APIs / FastAPI
    Strong background in data modelling and architecture frameworks
    Experience with CI/CD (Azure DevOps, GitHub Actions)
    Knowledge of Docker, Kubernetes basics, API gateways, and load balancing

    AI & Future-Ready Skills
    Exposure to AI/ML, GenAI, Agentic AI
    Passion for building future-ready, scalable data ecosystems

    Leadership & Soft Skills
    Proven experience leading medium to large technical teams
    Strong decision-making and problem-solving ability
    Excellent communication and stakeholder management skills
    Ability to operate independently with high ownership and accountability
    Adaptable, with a continuous learning mindset


    Nice to Have
    Experience with Kafka, Hadoop, Spark Streaming
    Workflow orchestration tools (Airflow, Luigi, Azkaban)
    BI tools like Power BI or Qlik Sense
    Certifications in Azure, Databricks, or AI/ML
    Exposure to logistics, trading, or freight-related domains

    Similar Jobs

    See more jobs