All jobs → Partner boards

Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Amazon Web Services • Cupertino, CA, US • published 2026-09-26 15:51:07.548868

Description

**DESCRIPTION** --------------- The Annapurna Labs team at Amazon builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance. The High\-Performance Inference Systems \& Acceleration team is at the forefront of running a wide range of models and supporting novel architecture alongside maximizing their performance for AWS's custom ML accelerators. Working across the stack from PyTorch till the hardware\-software boundary, our engineers build systematic infrastructure, innovate new methods and create high\-performance kernels for ML functions, ensuring every compute unit is fine tuned for optimal performance for our customers' demanding workloads. We combine deep hardwar...

Get jobs like this daily in Telegram: @careeri_bot