GPU Software Architecture Engineer

Summary

Apple Silicon GPU SW architecture team is seeking a senior/principal engineer to lead server-side ML acceleration and multi-node distribution initiatives. You will help define and shape our future GPU compute infrastructure on Private Cloud Compute that enables Apple Intelligence.

Description

In this role, you'll be at the forefront of architecting and building our next-generation distributed ML infrastructure, where you'll tackle the complex challenge of orchestrating massive network models across server clusters to power Apple Intelligence at unprecedented scale. It will involve designing sophisticated parallelization strategies that split models across many GPUs, optimizing every layer of the stack—from low-level memory access patterns to high-level distributed algorithms—to achieve maximum hardware utilization while minimizing latency for real-time user experiences. You'll work at the intersection of cutting-edge ML systems and hardware acceleration, collaborating directly with silicon architects to influence future GPU designs based on your deep understanding of inference workload characteristics, while simultaneously building the production systems that will serve billions of requests daily.nnThis is a hands-on technical leadership position where you'll not only architect these systems but also dive deep into performance profiling, implement novel optimization techniques, and solve unprecedented scaling challenges as you help define the future of AI experiences delivered through Apple's secure cloud infrastructure.

Minimum Qualifications

Strong knowledge of GPU programming (CUDA, ROCm) and high-performance computingnnMust have excellent system programming skills in C/C++, Python is a plus nnDeep understanding of distributed systems and parallel computing architecturesnnExperience with inter-node communication technologies (InfiniBand, RDMA, NCCL) in the context of ML training/inferencennUnderstand how tensor frameworks (PyTorch, JAX, TensorFlow) are used in distributed training/inferencennTechnical BS/MS degree

Preferred Qualifications

Familiar with model development lifecycle from trained model to large scale production inference deploymentnnProven track record in ML infrastructure at scale

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.u003cbru003eu003cbru003eApple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. u003ca href='https://www.apple.com/careers/us/benefits.html' target='_blank' aria-label='Learn more about Apple Benefits (Opens in new window)'u003eLearn more about Apple Benefits.u003cspan class='icon icon-after icon-external' aria-hidden='true'u003eu003c/spanu003eu003c/au003eu003cbru003eu003cbru003eNote: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.u003cbru003e