Staff AI Engineer, Data Analytics & Modeling - Office Of The CTO Sonatus, IncStaff AI Engineer, Data Analytics & Modeling - Office Of The CTOSunnyvale, CA$188,000–$300,000 / yearThe pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, geographic location and external market pay for comparable jobs. The Opportunity: Sonatus is seeking a highly motivated Staff AI Engineer with expertise in data analytics and modeling to build AI-based software for next-generation AI-driven software-defined vehicles.
Software Engineer - Data Platform TwitterSoftware Engineer - Data PlatformPalo Alto, CA$180,000–$440,000 / yearWe own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability.
Data Infrastructure Engineer Stride SearchData Infrastructure EngineerMountain View, CaliforniaExperience in different web deployment stacks - JVM/Scala, Solr, Elastic Search • Good team player; experience in leading small teams (3-4). The successful candidate has demonstrated experience in building high- performing consumer oriented data infrastructure that are scalable and extensible.
Sr. Staff Production Engineer - Data Platform DataBricksSr. Staff Production Engineer - Data PlatformMountain View, CA$228,600–$314,250 / yearData Platform Optimization: Own the operational integrity of the Data Platform that powers our internal AI models, ensuring 99.99% availability for the compute, storage, and control plane services used by thousands of Databricks engineers. More than 20,000 organizations worldwide - including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 - rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents.
Senior Backend Software Engineer Node.js | Java | Python | AWS | APIs | Data Pipelines | MarTech Pyramid Consulting, IncSenior Backend Software Engineer Node.js | Java | Python | AWS | APIs | Data Pipelines | MarTechOakland, CA$60–$65 / hourBy applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Immediate need for a talented Senior Backend Software Engineer – Node.js | Java | Python | AWS | APIs | Data Pipelines | MarTech .
Data Analyst / Engineer PeopleNTech LLCData Analyst / EngineerSanta Clara, CARoles & Responsibilities: Own end-to-end analytics for complex problem spaces, translating ambiguous business needs into structured analyses, KPIs, and actionable insights. Design and develop scalable data queries and transformations using SQL, Python, and Databricks on large, distributed datasets.
Software Engineer, Data Product Platform Notion Labs IncSoftware Engineer, Data Product PlatformSan Francisco, CA$196,000–$261,000 / yearSkills Youll Need to Bring: Curiosity in working across the stack: You enjoy understanding systems end-to-end-from product surfaces to infrastructure and data flows-and improving them with a hands-on, learn-by-doing mindset. You'll work on all levels of the stack including infrastructure, libraries and product code as needed to successfully build and deliver internal platforms that provide high leverage to multiple product teams.
Staff Research Engineer, Data Agents DataBricksStaff Research Engineer, Data AgentsSan Francisco, CA$190,000–$270,000 / yearMore than 20,000 organizations worldwide - including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 - rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. As a member of this team, you will bridge the gap between cutting-edge AI research and product development by shipping direct improvements to Genie, Databricks' agent product that provides significant value to our user base.
Backend Software Engineer, Trading Systems & Data Platform Arta Finance Wealth Management LLCBackend Software Engineer, Trading Systems & Data PlatformCA$110,000–$180,000 / yearOur offers are based on salary bands that are updated periodically using market benchmarks and consider geographic location as well (for example, higher cost regions like San Francisco or New York). Think of it as your own digital family office, combining intelligent investment strategies, alternative assets, private market access, and smart automation to help you grow and protect your wealth effortlessly.
Staff Software Engineer, Gemini App, Data Engineering, DeepMind Google LLCStaff Software Engineer, Gemini App, Data Engineering, DeepMindMountain View, CALeveraging your experience in building and running scalable systems, and utilizing modern data warehouse infrastructure at Google, you will lead a small team of executive and junior engineers to scale the data pipelines that drive Gemini Apps's analytics and power model and product improvement. You will work directly with key stakeholders, including our Data Science, model release, model quality, and feature teams, as well as teams across DeepMind, to identify and solve key problems to help make Gemini the next billion-user product.
Software Engineer, Data Infrastructure & Acquisition - Fremont, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - Fremont, CA, USAFremont, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
Software Engineer, IR Data Products Muon Space incSoftware Engineer, IR Data ProductsSan Jose, CA$156,000–$186,000 / yearTo conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. Muon''s IR Data Products team builds the analytics system that turns raw imagery from our spacecraft''s custom multispectral instruments into calibrated, orthorectified, analysis-ready products - and delivers them fast enough to be useful while a fire is still burning.
Staff Machine Learning Engineer, Data Flywheel Waymo LLCStaff Machine Learning Engineer, Data FlywheelMountain View, CA$250,000–$334,530 / yearWe have access to millions of miles of driving data from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently and continuously learning from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the complexities of interacting with the real-world, and (4) optimize models for our onboard and offboard hardware. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World''s Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes.
NewSoftware Engineer, Data Infrastructure & Acquisition - Cupertino, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - Cupertino, CA, USACupertino, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
Staff Research Engineer, Data Agents Databricks IncStaff Research Engineer, Data AgentsSan Francisco, CA$190,000–$270,000 / yearDevelop the best post-training recipes to train enterprise Data agents, that are capable of autonomous planning, code generation, and multi-step workflow execution within intricate enterprise settings. As a member of this team, you will bridge the gap between cutting-edge AI research and product development by shipping direct improvements to Genie, Databricks'' agent product that provides significant value to our user base.
Software Engineer, Data Platform Nuro IncSoftware Engineer, Data PlatformMountain View, CA$160,360–$240,540 / yearWith technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale-empowering a safer, richer, and more connected future. Domain experience: Experience working with large scale data and building scalable & reliable systems/data pipelines; ability to understand and design complex systems.
ML Engineer / Data Scientist Macpower Digital Assets Edge Private LimitedML Engineer / Data ScientistCupertino, CA$68 / hourEnd-to-end experience in developing machine learning and deep learning solutions , including predictive modeling, applied machine learning , and natural language processing . Strong communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders , and to collaborate effectively with cross-functional teams .
Software Engineer, Data Infrastructure Thinking Machines Lab IncSoftware Engineer, Data InfrastructureSan Francisco, CA$350,000–$475,000 / yearWe are scientists, engineers, and builders who've created some of the most widely used AI products, including ChatGPT and Character.ai, open-weights models like Mistral, as well as popular open source projects like PyTorch, OpenAI Gym, Fairseq, and Segment Anything. If you''re excited by distributed systems, large-scale data mining, open-source tools like Spark, Kafka, Beam, Ray, and Delta Lake, and enjoy building from the ground up, we''d love to hear from you.
Senior Software Engineer, Data Infrastructure RobloxSenior Software Engineer, Data InfrastructureSan Mateo, CA$243,290–$295,250 / yearEvery day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.
Analytics Engineer, Data Insights MERUAnalytics Engineer, Data InsightsSan Francisco, CAWe provide advisory services and data analytics support to middle-market companies ($50M - $2B in annual sales), and our clients include private equity firms, credit funds, investment banks, and law firms. Data Insights: Work with companies at all stages of their digital transformation journey to automate reporting processes, build scalable data platforms, and leverage predictive analytics to transform data from a liability into an asset.
Software Engineer, Data Infrastructure & Acquisition - Mountain View, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - Mountain View, CA, USAMountain View, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
Software Engineer, Data Infrastructure & Acquisition - Palo Alto, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - Palo Alto, CA, USAPalo Alto, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
NewSoftware Engineer, Data Infrastructure & Acquisition - San Jose, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - San Jose, CA, USASan Jose, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
NewSoftware Engineer, Data Infrastructure & Acquisition - Oakland, CA, USA SpeechifySoftware Engineer, Data Infrastructure & Acquisition - Oakland, CA, USAOakland, CAOver 50 million people use Speechify’s text-to-speech products to turn whatever they’re reading – PDFs, books, Google Docs, news articles, websites – into audio, so they can read faster, read more, and remember more. These include frontend and backend engineers, AI research scientists, and others from Amazon, Microsoft, and Google, leading PhD programs like Stanford, high growth startups like Stripe, Vercel, Bolt, and many founders of their own companies.
Software Engineer - Data Platform SpaceXAISoftware Engineer - Data PlatformPalo Alto, CA$180,000–$440,000 / yearWe own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability.
Staff Data Science Engineer - Hardware & Silicon Validation Marvell Technology IncStaff Data Science Engineer - Hardware & Silicon ValidationSanta Clara, CACollaboration with Engineering Teams: Work closely with hardware, firmware, and validation engineers to understand data, define metrics, and translate complex data into actionable insights Automation & Efficiency: Build tools and workflows that reduce manual debugging effort and accelerate validation cycles. Highlights include an employee stock purchase plan with a 2-year look back, family support programs to help balance work and home life, robust mental health resources to prioritize emotional well-being, and a recognition and service awards to celebrate contributions and milestones.
Senior Manager, Data Engineering ScribdSenior Manager, Data EngineeringSan Francisco, CaliforniaYou'll work closely with our Principal Data Engineer, who leads the technical direction of our Platform Engineering function, while partnering with the Director of Data Platform on long-term strategy, organizational planning, and cross-functional priorities. In the United States, outside of California, the reasonably expected salary range is between $154,500 [minimum salary in our lowest US geographic market outside of California] to $252,000 [maximum salary in our highest US geographic market outside of California].
Senior Data Scientist - Verification & Validation ZooxSenior Data Scientist - Verification & ValidationFoster City, CA$256,000–$307,000 / yearWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. Inform Strategy: Deliver clear, data-driven insights to development teams to guide system improvement, and to executive leadership to inform milestone-level go/no-go decisions.
NewData Engineer (AVANADE) BC ForwardData Engineer (AVANADE)Pleasanton, CA$50–$58.82 / hourFull timeThe ideal candidate will have strong experience in Databricks, PySpark, Python, Spark SQL, and Informatica and a proven ability to lead complex data platform modernization and migration initiatives from legacy Oracle and Informatica platforms to Databricks. BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients.
Staff Software Engineer - Payroll AI RipplingStaff Software Engineer - Payroll AISan Francisco, CARight now, that means we are building AI-native onboarding experiences leveraging LLMs to conversationally guide users through dense, regional tax and payroll configurations, while pairing them with deterministic backend systems to guarantee flawless data precision. For office-based employees (employees who live within a defined radius of a Rippling office), Rippling considers working in the office, at least three days a week under current policy, to be an essential function of the employees role.
NewSenior Principal RFIC Design Engineer WDSenior Principal RFIC Design EngineerSan Jose, CAResponsibilities include transistor level, block level and module level circuit architecture, design, simulation, optimization, layout supervision, layout verification, preparation of test plan for the testing team, reliability and yield assessment and modeling, simulation to bench and bench to test correlation, bench evaluation both at silicon level and at applications level, and documentation. We combine deep engineering expertise with global-scale manufacturing to deliver the storage systems that make AI possible, powering hyperscale data centers, cloud platforms, and enterprise infrastructure worldwide.
Expert IT Product Owner AxelonExpert IT Product OwnerOakland, CA$90–$115 / hourPartner with data stewards and SMEs to confirm source-of-truth logic, asset hierarchy, equipment identifiers, alarm definitions, inspection data, maintenance data, and operational rules. Experience supporting AI use cases related to asset health, alarms, inspections, maintenance optimization, work planning, or operational risk.
AI-Native Data Engineer - TrueMeter Pear VCAI-Native Data Engineer - TrueMeterPalo Alto, CaliforniaThe grid is breaking under the weight of AI and electrification — data centers are driving record demand, renewables are lagging, and energy costs are climbing 3x faster than inflation. We’re Stanford-alum founders backed by top Silicon Valley investors, growing fast, and hiring an elite set of AI-native engineers to help us scale.
Senior Data Engineer - Marketing Analytics Pride Technologies LLCSenior Data Engineer - Marketing AnalyticsMenlo Park, CARemote$75–$85 / hourRussell Tobin is supporting a leading global technology organization in hiring a Senior Data Engineer to help build scalable data pipelines, automated reporting solutions, and analytics infrastructure for a high-impact growth marketing team. The successful candidate will have experience working with very large datasets, building production-level pipelines, and using SQL to turn complex data into actionable insights.
Data Engineer III Pride Technologies LLCData Engineer IIIMenlo Park, CAOnly applicable for San Francisco Candidates: Under the San Francisco Lactation in the Workplace Ordinance, we will provide written notice of lactation accommodation rights, and this notice will automatically be given upon hiring, any inquiry of parental leave or lactation accommodation. Summary: The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization.
Senior Data Engineer AirCapture LLCSenior Data EngineerBerkeley, CA$180,000–$220,000 / yearPartnering with cross-functional stakeholders, you will build and operate production data systems, defining what good looks like, making durable choices that hold up over time. Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent hands-on industry experience, Master's preferred.
Senior Data Engineer I - QuantumBlack, AI by McKinsey (Critical Industries) McKinsey & Co IncSenior Data Engineer I - QuantumBlack, AI by McKinsey (Critical Industries)San Francisco, CAStrong experience building Agentic AI, Generative AI, Machine Learning, and Business Intelligence systems, including prompt design, retrieval-augmented generation (RAG), embeddings, vector databases, context construction, and output handling in production workflows using modern frameworks (Spark, LangChain, Databricks, Dask, Airflow, Dagster, Kedro, etc.). Youll lead the integration of machine learning, Generative AI capabilities and agentic frameworks into client solutions, designing MLOps/LLMOps-focused architectures for model management, observability, and automated retraining.
Human Data Engineer X CorpHuman Data EngineerPalo Alto, CA$144,000–$270,000 / yearYou sit at the intersection of engineering and data operations: partnering with model teams, designing projects that capture meaningful signals, and driving data yield and eval lift. ABOUT THE ROLE: You will ensure engineering teams get the right data they need-high-quality tasks and evaluations-by crafting and executing high-value Human Data projects.
Data Engineer II - QuantumBlack, AI by McKinsey McKinsey & Co IncData Engineer II - QuantumBlack, AI by McKinseySan Francisco, CAProven experience building end-to-end data pipelines and platforms for Agentic AI, Generative AI, Machine Learning, or Business Intelligence, covering data preparation, embeddings generation, vector search, and system integration using modern frameworks (Spark, dbt, LangChain). Experience building systems with different data formats (structured vs unstructured) and data processing methods (streaming vs batch) and deploying across major cloud platforms (AWS, Azure, GCP).
Data Scientist/Engineer - Junior (Remote) SynergisticITData Scientist/Engineer - Junior (Remote)Dublin, CARemote$95,000–$154,000 / yearSince 2010, Synergisticit has helped thousands of candidates land full-time jobs at tech leaders like Google, Apple, PayPal, Visa, Western Union, Wells Fargo, Client, Paypal, Banking, Wayfair, Client, Client and hundreds more with Job offers of $95k to $154k. Currently, We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/Data Engineers/ Data Scientists, Machine Learning engineers for full time positions with clients.
Data Engineer - US Bambulabs IncData Engineer - USSan Jose, CA$140,000–$200,000 / yearLead the design and end-to-end development of offline data warehouses, encompassing layered data modeling, pipeline development, and data governance practices to guarantee data accuracy, consistency, and long-term operational stability. Keen data intuition paired with strong business acumen: able to translate business requirements into scalable data architecture, and design well-structured data warehouse models focused on stability, extensibility and long-term maintainability.
Staff Engineer, Data Platform Lila SciencesStaff Engineer, Data PlatformSan Francisco, Massachusetts$192,000–$272,000 / yearFull-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program. Data Modeling and Schema Strategy: Define and maintain data models, schema evolution practices, and data contracts that ensure consistency, discoverability, and long-term durability of scientific and platform data assets.
Staff Engineer - Data Engineering Early Warning Services, LLCStaff Engineer - Data EngineeringSan Francisco, CA$175,000–$225,000 / yearWe're looking for a Staff Data Engineer to help build and evolve the modern data platform behind Zelle, one of the largest digital payments networks in the U.S. This role is perfect for an engineer who enjoys solving large-scale distributed data challenges, influencing architecture, and building cloud-native data platforms that powers next generation Payment products, analytics, and supports AI/ML workloads. Early Warning Services takes into consideration a variety of factors when determining a competitive salary offer, including, but not limited to, the job scope, market rates and geographic location of a position, candidate's education, experience, training, and specialized skills or certification(s) in relation to the job requirements and compared with internal equity (peers).
Senior Data Center Operations Engineer Milestone Technologies IncSenior Data Center Operations EngineerSunnyvale, CAThe Senior Data Center Operations Engineer plays a critical, hands-on role in supporting the build-out and long-term operation of a high-performance, enterprise-scale data center environment supporting advanced compute and large-scale infrastructure deployments. This role offers continuity across both deployment and operational phases and provides exposure to large-scale, modern infrastructure environments, with a clear path for progression into advanced technical or engineering roles.
Sr. Staff Data Engineer ArcherSr. Staff Data EngineerSan Jose, CA$207,400–$259,200 / yearWe're looking for a Senior Staff Data Engineer who brings deep expertise in data modeling and warehouse design: someone who can architect scalable, well-structured data systems and set the technical direction for how data is organized, governed, and consumed across the company. Archer is an aerospace company based in San Jose, California building an all-electric vertical takeoff and landing aircraft with a mission to advance the benefits of sustainable air mobility.
Staff Software Engineer, Data Platform DiscordStaff Software Engineer, Data PlatformSan Francisco, CA$248,000–$310,000 / yearIf you're the kind of Staff Engineer who sees ambiguity as an invitation - who builds systems that make whole teams faster, shapes technical strategy across the org, and wants your decisions to directly impact millions of gamers worldwide - we want to talk to you. Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties).
Staff Software Engineer, AI Data Platform Labelbox, IncStaff Software Engineer, AI Data PlatformSan Francisco, CAThe bar is high: engineers who have strong judgment and set technical direction, quickly build prototypes that scale into the reliable systems, and are at the frontier of agent-first engineering practices and innovating to accelerate the speed of the business. Our engineering team works with a modern tech stack designed for scalability, performance, and developer efficiency: Frontend: React.js with Redux, TypeScript.
Data Engineer, Principal (Hybrid) ReleadyData Engineer, Principal (Hybrid)San Francisco, CaliforniaThis role reports to a Senior Manager, Data Solutions, or Director, and partners with Enterprise Architects, Portfolio, Analytics, and Data Engineering teams to design technical solutions and build data products that meet enterprise-wide data needs. The Principal drives data product delivery by designing and implementing cloud data lakes, data warehouse, and data mart solutions, and is expected to influence enterprise architecture decisions and mentor senior engineering talent.
Staff Software Engineer - Data Platform HivemapperStaff Software Engineer - Data PlatformSan Francisco, CaliforniaThe Platform Engineering team is responsible for the core distributed systems, ML infrastructure, data model abstractions, and data engine that powers our data customers, consumer products, and user-facing AI technology. APIs allow anyone to consume precisely extracted Map Features, HD map data, high-res street-level imagery, construction, and driving events for AV simulation.
Software Engineer, Growth Data Platform omniSoftware Engineer, Growth Data PlatformSan Francisco, CATeams use Omni to ask questions in plain English, refine answers in workbooks, and bring trusted data into tools like Claude, ChatGPT, Cursor, and Slack. Deep experience with analytical data systems such as Snowflake, Databricks, BigQuery, dbt, Spark, Airflow, Dagster, or similar tools.