Staff Software Engineer
IBM
Austin, TX
Apply
JOB DETAILS
LOCATION
Austin, TX
POSTED
30+ days ago
About Us:
We’re a FinOps platform helping organizations optimize and control cloud spend across AWS and other major cloud providers. Our data-driven approach gives engineering and finance teams full visibility into usage, cost anomalies, and savings opportunities at scale.
We process hundreds of billions of lines daily, ingesting cloud bills, Kubernetes cluster details, and utilization metrics to derive actionable insights. If you're passionate about building scalable systems that make cloud usage smarter and more cost-efficient, this is the place for you.
About the Role:
We’re looking for a Staff Software Engineer with strong experience with Apache Spark, large-scale data processing, data partitioning and cluster performance tuning. You’ll play a key role in scaling our data processing pipelines, optimizing cost-to-performance, and driving architectural decisions for our big data platform.
You will also mentor a team of engineers and be a technical leader in our mission to help customers take control of their cloud spend.
Your role and responsibilities
Key Responsibilities:
* Architect and implement scalable batch data pipelines using Apache Spark in Scala.
* Drive optimization of massive datasets including AWS, GCP, Azure biling cost and usage data—with attention to input partitioning, join strategies, and memory/shuffle tuning.
* Reduce platform processing costs while improving performance, aligning directly with FinOps principles.
* Lead the design of fault-tolerant, cost-efficient big data infrastructure on AWS
* Mentor team members, lead technical design reviews, and contribute to the evolution of the engineering culture.
* Collaborate with product, platform, and FinOps experts to develop new capabilities that provide cost insights and recommendations to customers.
Tech Stack:
* Languages: Scala (primary), Java (secondary)
* Big Data: Apache Spark (on EMR), Snowflake
* Cloud: AWS (EMR, S3, Lambda, CloudWatch,)
* CI/CD: GitHub Actions, Terraform, Kubernetes, DataDog, Splunk
Required technical and professional expertise
* 8+ years of software engineering experience, with 5+ years building distributed data pipelines in Spark.
* Strong command of Scala and functional programming.
* Deep expertise in cluster resource tuning, data partitioning, and performance benchmarking in Spark.
* Experience with AWS data services including S3, CloudWatch, and IAM.
* Proven track record of designing systems that balance performance with cost-efficiency — ideally in a FinOps or similar optimization-focused context.
* Ability to lead projects end-to-end and mentor junior engineers.
Preferred technical and professional experience
* Usage of AWS EMR
* Exposure to cloud billing/usage data (AWS CUR, Cost Explorer, etc.)
* Familiarity with FinOps practices and cloud cost management principles.
* Experience working with data formats like Parquet or Apache Iceberg.
* Prior experience in startups or high-growth SaaS environments.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
About the Company
I
IBM
At IBM, you don’t need a degree to shape the future. Just bring your skills—and your passion. To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate.
Not just to do something better, but to attempt things you've never thought possible. To lead in this new era of technology and solve some of the world's most challenging problems. Let’s get to work.
COMPANY SIZE
10,000 employees or moreINDUSTRY
Computer/IT Services
FOUNDED
1911
WEBSITE
http://www-03.ibm.com/employment/us/