The Vision Product Group is working on exciting new technologies. We are looking for a driven and dedicated performance engineer. This team is building the core foundational platform for some of Apple's most advanced technologies in spatial computing. As part of our creative organization, you will have a uniquely rewarding opportunity to craft future products that will delight and inspire millions of people every day.
As an engineer in this role you will help with ANE efficiency as well as improving overall visionOS responsiveness. You will work closely with Computer Vision and Foundation Model teams to diagnose performance bottlenecks and develop innovative solutions to optimize compute and memory footprint. Your responsibilities will include:
Analyze, benchmark and identify performance bottlenecks for ML/Foundation models in Vision Pro
Develop in-house performance solutions (such as analysis tools) to optimize inference stack & identify performance wins.
Conduct deep-dive analysis to identify & reduce bottlenecks and measure inference improvements in terms of memory, compute and latency.
Partner with feature and product teams to consult on algorithm and SW architectural design decisions to achieve visionOS performance goals
Optimize SW and HW via tunable parameters & integrate research findings into product implementation
Designing and implementing computer vision and machine learning algorithm optimizations; CPU C++ implementations and python bridge to TensorFlow/Pytorch;
Identify performance bottlenecks in software C++ code using advanced CPU profiling technologies and in ML networks.
Analyzing performance issues and resolving performance regressions reported by Apple's users around the world.
Developing microbenchmarks and performance validation tests to catch performance regressions in computer vision and machine learning algorithms to preserve the performance quality of Apple's products.
Working on integration of Foundation Models (including LLMs) into Apple Vision Pro and making sure it meets power and performance targets.
Working with Apple's customers to troubleshoot performance issues and suggest optimizations across a variety of use cases; and
Working on analytical and simulation models to predict application, algorithm, OS and real time interactive graphics performance and power.
Minimum BS and 1+ years of relevant industry experience
Familiarity with Operating Systems, embedding programming, parallel programming.
Academic or industry experience using C/C++, Python or Swift
Understanding of compilers, runtimes, system performance, system software engineering and ML architectures.
Familiarity with optimizing inference latency, memory and compute.
Familiarity with Gen AI coding tools. Demonstrated ability to use them for design, code generation, and debugging.
Familiarity with PyTorch, Tensorflow or CoreML
Knowledge of AI/ML fundamentals including model evaluation and deployment/inference.
Familiarity with optimizing model architectures for on-device inference
Familiarity with Computer Vision, Transformers and LLM architectures.
Exceptional written and verbal communication skills
We’re a diverse collection of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. The people who work here have reinvented entire industries with the Mac, iPhone, iPad, and Apple Watch, as well as with services, including iTunes, the App Store, Apple Music, and Apple Pay. And the same passion for innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it.
There’s a place here for every kind of brilliant. Everyone here is an innovator, or an innovator-to-be, no matter what your team or your role. So bring your passion, courage, and original thinking and get ready to share it, because every new product, service, or feature we invent is the result of people working together to make each others’ ideas stronger. Innovation at this level depends on people who represent the variety of the human experience and inspire us with their own fresh perspectives. Together, we’ll do amazing work that can make a difference in people’s lives. Including your own. Learn more about working at Apple.