Senior Manager, Software Development - AI Systems and Server, Annapurna Labs, Annapurna Labs

At Annapurna Labs, we sit at the forefront of hardware and software accelerator solutions-not just for Amazon Web Services (AWS), but across the entire industry. Our AI Systems and Server team is building the next generation of Management and Orchestration platforms for AI/ML servers, and we"re looking for a leader excited to dive deep into modern orchestration, provisioning, network management, and operations.

Our team designs, builds, deploys, and operates Annapurna"s fleet of accelerated servers, powered by our world-class, internally designed AI accelerator silicon, systems, and software. The systems we build support the largest AI applications in the world, alongside the most innovative startups and research universities.

In this role, you will lead a team of software and firmware developers responsible for overall system orchestration, deployment, and operations-spanning low-level boot, security management, provisioning, updates, and monitoring across both on-premise and off-premise environments.

A day in the life

• Lead a team of software and firmware developers driving the architecture and development of our newest ML/AI Systems Orchestration and Management platform.
• Partner with Systems, AWS/EC2, and Annapurna hardware and software teams to build a standalone orchestration management system that deploys and manages current and future ML/AI rack- and server-level systems at scale-including accelerator, networking, and storage systems-with a strong bias toward industry standards and best-in-class solutions.
• Collaborate across organizations to design a system that leverages existing internal infrastructure where practical, while driving toward a next-generation, customer-focused platform that is industry-standard, compliant, and OCP-compatible.
• Mentor your team through complex technical challenges and establish a minimal viable system optimized for time-to-market that scales across products.
• Shape system design and orchestration strategy through technical and customer discussions, balancing short-term on-premise proof points with the simplest possible customer adoption path for their workloads.