Staff AI Performance Engineer

EngineersOfAI

  • Austin, TX
  • 2 days ago

    Highlights

    Responsibilities and DutiesAnalyze ML models' compute and memory requirements using roofline analysis and simulationsCollaborate across hardware and software teams to optimize large-scale AI workloadsBenchmark, monitor, and troubleshoot system performance across distributed systemsOptimize communication stacks including MPI, NCCL, UCX, RDMA, and networking fabricsProfile and optimize AI workloads, focusing on performance bottlenecksDevelop high-quality, ARM-compatible code and documentationCandidate ProfileEssential:BS/MS in Computer Science, Electrical Engineering, or related fieldExperience with distributed systems and communication libraries (MPI, NCCL, UCX, libfabric)Strong programming skills in C++ and PythonExperience profiling and optimizing HPC or AI/ML workloadsFamiliarity with ML benchmarks such as MLPerfDesirable:Experience with GPUs or accelerated computing architecturesKnowledge of HPC networking and interconnect technologies (InfiniBand, RoCE)Familiarity with ML frameworks such as PyTorch or TensorFlowUnderstanding of ARM architectures and toolchainsStrong debugging, profiling, and performance optimization skills#J-18808-Ljbffr. This role focuses on optimizing performance across ARM-based architectures and large-scale distributed systems, ensuring efficiency, scalability, and reliability across the full hardware-software stack.

    Numbers & Facts

    LocationAustin, TX

    Description

    About usGraphcore is one of the world's leading innovators in Artificial Intelligence compute.It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world's most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.Graphcore's teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation.Job SummaryGraphcore's AI/ML training and inference infrastructure is rapidly scaling to meet the growing demands of AI workloads across mobile, edge, and datacenter environments. This role focuses on optimizing performance across ARM-based architectures and large-scale distributed systems, ensuring efficiency, scalability, and reliability across the full hardware-software stack.The TeamThe System Engineering Performance team architects and optimizes high-performance infrastructure for large-scale datacenter deployments. The team works across hardware, software, networking, and system architecture to deliver cutting-edge AI solutions and ensure optimal system performance at scale.Responsibilities and DutiesAnalyze ML models' compute and memory requirements using roofline analysis and simulationsCollaborate across hardware and software teams to optimize large-scale AI workloadsBenchmark, monitor, and troubleshoot system performance across distributed systemsOptimize communication stacks including MPI, NCCL, UCX, RDMA, and networking fabricsProfile and optimize AI workloads, focusing on performance bottlenecksDevelop high-quality, ARM-compatible code and documentationCandidate ProfileEssential:BS/MS in Computer Science, Electrical Engineering, or related fieldExperience with distributed systems and communication libraries (MPI, NCCL, UCX, libfabric)Strong programming skills in C++ and PythonExperience profiling and optimizing HPC or AI/ML workloadsFamiliarity with ML benchmarks such as MLPerfDesirable:Experience with GPUs or accelerated computing architecturesKnowledge of HPC networking and interconnect technologies (InfiniBand, RoCE)Familiarity with ML frameworks such as PyTorch or TensorFlowUnderstanding of ARM architectures and toolchainsStrong debugging, profiling, and performance optimization skills#J-18808-Ljbffr

    Similar Jobs

    • Staff SW Engineer Visa Technology and Operations LLC

      Austin, TX7 days ago
      • $131,600–$210,300 Per Year
    See more jobs