Staff Software Engineer, On-Device Machine Learning

Staff Software Engineer On-Device Machine Learning - Google Careers

Careers Home Jobs Students Google How we work How we hire Your career Help

Job details Back to jobs search

Jobs search results 3788 jobs matched

Head of YouTube Music Partnerships SEA and AUNZ Singapore

Business Finance Analyst Japanese English Tokyo Japan

Financial Analyst Real Estate Sunnyvale CA USA

Account Manager Google Public Sector Finance LCS English Spanish Buenos Aires Argentina

Program Manager Data Center Maintenance Planner Vienna Austria

Field Sales Representative II Enterprise Google Cloud New York NY USA

Platform Customer Engineer III FSI Google Cloud New York NY USA

VP Workspace Drive Sunnyvale CA USA Boulder CO USA 2 more 1 more

Engineering Manager Google One Growth Infrastructure Bengaluru Karnataka India

Technical Program Manager Pixel Hardware New Taipei Banqiao District New Taipei City Taiwan

Product Manager I YouTube Growth Platform San Bruno CA USA

Technical Account Manager Associate Google Cloud Consulting Sunnyvale CA USA San Francisco CA USA

Staff UX Researcher Google Cloud Platform Service Experience Seattle WA USA

Software Engineer II Account Threats Zürich Switzerland

Engineering Director Google Cloud Business Platform Bengaluru Karnataka India Hyderabad Telangana India

Field Sales Representative III Growth Startups Google Cloud San Francisco CA USA Sunnyvale CA USA

Test Engineer User Experience Quality New Taipei Banqiao District New Taipei City Taiwan

Technical Program Manager Google Play Games Bengaluru Karnataka India

Staff Conversational Designer Google Cloud Applied AI Sunnyvale CA USA

Customer Engineer Google Cloud Platform New York NY USA Cambridge MA USA

Showing 1 to 20 of 3788 rows 1‑20 of 3788 navigate_next

Follow Life at Google on

More about us About us Contact us Press

Related Information Investor relations Blog

Equal Opportunity Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition including breastfeeding, expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Googles EEO Policy. Know your rights: workplace discrimination is illegal. Belonging at Google and How we hire.

More about us Related information Equal opportunity Privacy Applicant & Candidate Privacy Terms Manage cookies

Help

Staff Software Engineer On-Device Machine Learning

Share link Copy link Email a friend

Google Sunnyvale CA USA

Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders, deep expertise in domain.

Apply

Share link Copy link Email a friend

Minimum qualifications

• Bachelors degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing and launching software products and 3 years of experience with software design and architecture.
• 5 years of experience with one or more of the following: Speech/audio e.g. technology duplicating and responding to the human voice, reinforcement learning e.g. sequential decision making, ML infrastructure, or specialization in another ML field.
• 5 years of experience with ML design and ML infrastructure e.g. model deployment, model evaluation, data processing, debugging, fine tuning.

Preferred qualifications

• Masters degree or PhD in Engineering, Computer Science or a related technical field.
• 8 years of experience with data structures and algorithms.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex matrixed organization involving cross-functional or cross-business projects.
• Experience in GenAI end-to-end workflow.
• Experience with mobile app development, experience and familiarity with iOS/Android build, testing, system.

About the job Googles software engineers develop the next-generation technologies that change how billions of users connect, explore and interact with information and one another. Our products need to handle information at massive scale and extend well beyond web search. Were looking for engineers who bring fresh ideas from all areas including information retrieval, distributed computing, large-scale system design, networking, and data storage, security, artificial intelligence, natural language processing, UI design, and mobile-the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Googles needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities, and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will provide leadership for the technical direction of On-Device Machine Learning and Generative AI at Google. This role demands an individual who can grow on ambiguity, taking complex open-ended problems such as the scaled deployment of Large Language Models on mobile hardware and making them tractable for the organization. You will lead efforts across multiple teams and stakeholders to define the well-lit paths for the next generation of on-device ML innovation. You will have an understanding of GenAI workflows and work up and down the stack with engineers on the On-Device Machine Learning (ODML) and hardware teams to define and build new developer tools to serve new LLM needs.

Google Cloud accelerates every organizations ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Googles cutting-edge technology and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $207,000-$300,000 (bonus, equity, benefits). Our salary ranges are determined by role level and location. Within the range, individual pay is determined by work location and additional factors including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only and do not include bonus, equity, or benefits. Learn more about benefits at Google.

Responsibilities

• Create roadmaps for developer-facing APIs, SDKs, and tools ensuring they meet the evolving needs of LLM workflows.
• Solve technically challenging problems that exceed the scope of a generalist Software Engineer, specifically around optimizing GenAI performance across heterogeneous hardware (CPUs, GPUs, and EdgeTPUs).
• Guide the team in designing resilient systems anticipating scaling bottlenecks or shifts in usage as LLMs become increasingly complex.
• Coordinate efforts across multiple groups including Android ML, ML Compiler, and DeepMind to co-design performance and evaluation workflows.
• Provide technical mentorship and implement new practices that address team needs and increase the velocity of your teammates.

Information collected and processed as part of your Google Careers profile and any job applications you choose to submit is subject to Googles Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition including breastfeeding, expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Googles EEO Policy. Know your rights: workplace discrimination is illegal. Belonging at Google and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company and in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Follow Life at Google on

More about us About us Contact us Press

Related Information Investor relations Blog

Equal Opportunity Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition including breastfeeding, expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Googles EEO Policy. Know your rights: workplace discrimination is illegal. Belonging at Google and How we hire.

More about us Related information Equal opportunity Privacy Applicant & Candidate Privacy Terms Manage cookies

Help

Google apps Main menu