Databricks Performance and FinOps Engineer

ConsultNet

  • South Jordan, UT
  • 6 days ago

    Highlights

    For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. It is a good fit for engineers who enjoy the forensic side of the work and can hold a defensible position when someone wants to solve a performance problem by buying more compute.

    Numbers & Facts

    LocationSouth Jordan, UT

    Description

    Databricks Performance and FinOps Engineer

    Job Summary

    The Databricks Performance and FinOps Engineer makes the platform faster and cheaper at the same time, and can prove both. This role owns compute strategy, workload tuning, and the cost visibility that lets leadership see where spend is going and why. It is a good fit for engineers who enjoy the forensic side of the work and can hold a defensible position when someone wants to solve a performance problem by buying more compute.

    Key Responsibilities

    • Analyze workload and cluster telemetry to find the jobs driving disproportionate cost or runtime

    • Tune Spark jobs and SQL workloads through partitioning, caching, join strategy, file layout, and skew handling

    • Define compute strategy across job clusters, serverless, SQL warehouses, and pools

    • Build cost allocation and chargeback reporting using system tables, tags, and budget policies

    • Set and enforce cluster policies and autoscaling configuration to prevent avoidable spend

    • Establish performance baselines and service level objectives for critical pipelines

    • Run cost reviews with engineering and finance stakeholders and translate technical drivers into budget language

    • Advise on photon adoption, runtime upgrades, and instance type selection

    Required Skills

    • 5+ years in data engineering or platform engineering with a focus on performance

    • Deep Spark tuning experience and fluency reading the Spark UI, query profiles, and execution plans

    • Hands on experience with Databricks system tables and usage analytics

    • Understanding of cloud pricing models for compute and storage across at least one major cloud

    • Strong SQL and Python

    • Ability to build reporting that non technical stakeholders will actually use

    Preferred Skills

    • FinOps Certified Practitioner credential

    • Experience with liquid clustering, predictive optimization, and photon workload assessment

    • Prior ownership of a platform cost reduction program with documented results

    • Experience with tagging strategy and enterprise cloud cost tooling


    Welcome to ConsultNet, a premier national provider of technology talent and solutions. Our expertise spans across project services, contract-to-hire, direct search, and managed services onshore, nearshore, and hybrid. For over 25 years, we have connected thousands of consultants with meaningful roles through a personal, communication-driven approach, partnering with a diverse client base to build high-performing teams and create lasting impact. Our comprehensive service offerings cover a wide range of technology and engineering positions across key markets nationwide. Learn more at www.consultnet.com .

    We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.




    Similar Jobs

    System One

    Network Engineer

    • Salt Lake City, UT
    1 day ago
    See more jobs