The Product: Join us in transforming the landscape of AWS with our advanced Machine Learning accelerators. The Inferentia chip offers unmatched ML inference performance at an affordable cost, while Trainium provides leading ML training capabilities with extensive compute power in the cloud. Our innovative AWS Neuron Software Development Kit (SDK) encompasses an ML compiler, runtime, and seamless integration with popular ML frameworks like PyTorch, TensorFlow, and MxNet. Major companies, including Snap, Autodesk, Amazon Alexa, and Amazon Rekognition, utilize AWS Neuron and Inferentia at scale. The Team: At Amazon Annapurna Labs, our focus is on silicon development at AWS, bringing together experts in silicon engineering, hardware design, software, and operations. The AWS Neuron team is dedicated to enhancing the performance of complex neural network models on our state-of-the-art hardware. We are building a deep learning compiler stack that efficiently converts neural network descriptions into executable code across various frameworks. Your Role: As a Machine Learning Compiler Engineer II on the AWS Neuron team, you will play a vital role in developing and scaling a compiler to manage large ML workloads. You'll design and implement essential features, engage in cutting-edge research, and collaborate with skilled engineers. Your technical communication skills will be crucial as you work hand-in-hand with AWS ML services teams, contributing to pre-silicon design and launching exciting new products and features. Why Join Us? We are committed to fostering an inclusive and diverse work culture where every team member can thrive. We value work-life balance, providing flexibility in working hours, and encourage finding the right harmony between professional and personal lives. Career Development: We prioritize mentorship and career growth, ensuring new members receive support and opportunities that contribute to their development as well-rounded professionals. BASIC QUALIFICATIONS: 3+ years of professional software development experience (non-internship). 2+ years of experience in architecting and optimizing compilers. Proficiency in one or more programming languages: C++ (preferred), C, Python. PREFERRED QUALIFICATIONS: M.S. or Ph.D. in Computer Science or related field. Experience with multiple toolchains and Instruction Set Architectures. Knowledge in resource management, scheduling, code generation, and compute graph optimization. Experience optimizing TensorFlow, PyTorch, or MxNET deep learning models. This position includes essential tasks such as working collaboratively, adhering to high standards, and ensuring exceptional customer service. Due to the relationship between criminal history and job duties, we will consider qualified applicants with arrest and conviction records as per applicable regulations. Our inclusive culture empowers our team to deliver outstanding results for our customers. If you require workplace accommodations during the application or hiring process, please reach out to our recruitment team for assistance. The base pay for this position ranges from $129,300/year in our lowest geographic market to $223,600/year in our highest geographic market, based on various factors including experience and location. Total compensation may include equity, sign-on bonuses, and comprehensive benefits. Job location may vary as needed.