Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge Platforms

Apple

Seattle, WA

JOB DETAILS
SKILLS
Amazon Web Services (AWS), Apple, Apple Siri, Artificial Intelligence (AI), CUDA (Compute Unified Device Architecture), Cloud Applications, Computer Hardware, Computer Science, Data Science, Deep Learning, Docker, GPU (Graphics Processing Unit), Go Programming Language (Golang), High Throughput, Information Retrieval, Kernel Programming, Leadership, Leading Edge Technology, Machine Learning, Mentoring, Microsoft Windows Azure, Music, Python Programming/Scripting Language, Safari Browser, Supercomputing, Systems Maintenance, Team Player, Use Cases
LOCATION
Seattle, WA
POSTED
30+ days ago
**Role Number:** 200651038-3337 **Summary** We are Foundation Model Inference Team, within AI, Search & Knowledge Platform Technologies organization. Our team is responsible to build Inference stack to power Apple Intelligence. It builds frameworks, services and tools that power the largest Apple foundation models on servers. Our Infrastructure powers a wide gamut of services at Apple including Apple Search, Apple Music, AppleTV, AppStore, iMessages, Photos & Camera, Spotlight, Safari, Siri and upcoming ever exciting Apple products serving millions of queries every day with incredible low latencies, drawing every ounce of compute from our hardware. As part of this group, you will get a chance to bring Intelligence to billions of users across the world. You will have an opportunity to make difference in life of people by empowering them with AI. You will have a chance to work on optimizing billions of parameter langauge and vision and speech models using state of the art technologies and make it run at scale of Apple. **Description** Work along side Foundation Model Research team to optimize inference for cutting edge model architectures. Work closely with product teams to build Production grade solutions to launch models serving millions of customers in real time. Build tools to understand bottlenecks in Inference for different hardwares and use cases. Mentor and guide engineers in the organization. **Minimum Qualifications** + 5+ years of experience leading and driving complex, ambiguous projects. + Experience with LLM inference stack + Familiarity with GPU programming concepts using CUDA. + Familiarity with one of the popular ML Frameworks like Pytorch, Tensorflow. + Have experience with high throughput services particularly at supercomputing scale. + Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc. + Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow. + BS in Computer Science, Artificial Intelligence, Machine Learning, Information Retrieval, Data Science or related field **Preferred Qualifications** + Proficient in building and maintaining systems written in modern languages (eg: Golang, Python) + Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models. + Familiarity with Nvidia TensorRT-LLM, vLLM, DeepSpeed, Nvidia Triton Server etc. + Experience writing custom CUDA kernels using CUDA or OpenAI Triton. + MS in Computer Science, Artificial Intelligence, Machine Learning, Information Retrieval, Data Science or related field.

About the Company

A

Apple

We bring amazing people together to make amazing things happen.

We’re a diverse collection of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. The people who work here have reinvented entire industries with the Mac, iPhone, iPad, and Apple Watch, as well as with services, including iTunes, the App Store, Apple Music, and Apple Pay. And the same passion for innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it.

About Apple

There’s a place here for every kind of brilliant. Everyone here is an innovator, or an innovator-to-be, no matter what your team or your role. So bring your passion, courage, and original thinking and get ready to share it, because every new product, service, or feature we invent is the result of people working together to make each others’ ideas stronger. Innovation at this level depends on people who represent the variety of the human experience and inspire us with their own fresh perspectives. Together, we’ll do amazing work that can make a difference in people’s lives. Including your own. Learn more about working at Apple.

COMPANY SIZE
10,000 employees or more
INDUSTRY
Other/Not Classified
FOUNDED
1976
WEBSITE
https://www.apple.com/jobs