Apple Inc logo

Senior ML Researcher: Multimodal LLM Post-Training

Apple Inc

  • Cupertino, CA
  • 10 days ago

    Highlights

    MS in Computer Science, Machine Learning, or a related field, or equivalent practical experience Minimum 4+ years of research experience in Multi-Modal LLM training and evaluation Proven track record in multimodal SFT plus at least one of distillation, preference optimization, or online RL, backed by shipped models or rigorous experiments Strong programming skills in Python and at least one deep learning, framework, such as JAX or PyTorch. PhD in Computer Science, Machine Learning, or a related field, or equivalent practical experience Experience in GRPO, DPO, Vision-OPD, and visual-token compression Publications in top-tier ML conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) Bonus: Experience in quantization, on-device models and SLM (Small Language Model).

    Numbers & Facts

    LocationCupertino, CA
    IndustryComputer/IT Services
    Company Size10,000 employees or more
    Year Founded1976
    Websitehttps://www.apple.com/jobs

    Description

    We are looking for a Senior ML Researcher who is passionate about foundation model post-training, including Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), and has experience with core capabilities such as instruction following, tool use, deep thinking, and reasoning. In this role, you will research, design, and deliver models where machine learning research meets real-world product impact. You will work closely with research scientists, engineers, and product teams to find new ways that generative AI can help our creative users. Your mission is to improve the workflows of millions of creators by combining generative AI with Apples human-centered design principles. What makes our work unique is we have many research opportunities in real-world use cases in multimodal space. Our goal is to develop targeted, task-specific capabilities within our models across a broad range of areas, including video understanding, reasoning, instruction following, and agentic tasks. The role involves contributing to every stage of the post-training process:

    Formulate hypotheses for a use case Define data collection and annotation Build evaluations of model capabilities Apply SFT, advanced reward modeling, RL techniques, and distillation to develop and improve the post-training recipe Execute experiments, validate results, and communicate findings to the broader team If youre passionate about doing research that ships in Apples legendary products, this is the team for you.MS in Computer Science, Machine Learning, or a related field, or equivalent practical experience Minimum 4+ years of research experience in Multi-Modal LLM training and evaluation Proven track record in multimodal SFT plus at least one of distillation, preference optimization, or online RL, backed by shipped models or rigorous experiments Strong programming skills in Python and at least one deep learning, framework, such as JAX or PyTorch. Ability to build intuition from a problem statement and translate it into dataset requirements, neural network design, and loss functions.PhD in Computer Science, Machine Learning, or a related field, or equivalent practical experience Experience in GRPO, DPO, Vision-OPD, and visual-token compression Publications in top-tier ML conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) Bonus: Experience in quantization, on-device models and SLM (Small Language Model)

    About Company

    We bring amazing people together to make amazing things happen.

    We’re a diverse collection of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. The people who work here have reinvented entire industries with the Mac, iPhone, iPad, and Apple Watch, as well as with services, including iTunes, the App Store, Apple Music, and Apple Pay. And the same passion for innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it.

    About Apple

    There’s a place here for every kind of brilliant. Everyone here is an innovator, or an innovator-to-be, no matter what your team or your role. So bring your passion, courage, and original thinking and get ready to share it, because every new product, service, or feature we invent is the result of people working together to make each others’ ideas stronger. Innovation at this level depends on people who represent the variety of the human experience and inspire us with their own fresh perspectives. Together, we’ll do amazing work that can make a difference in people’s lives. Including your own. Learn more about working at Apple.

    Similar Jobs