< More Jobs

Posted on 2026/07/15

Senior AI Software Architect

Microsoft Corp

Boston, MA, United States

Full-time

Qualifications

  • Bachelors Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Benefits

  • Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year

  • There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year

  • Certain roles may be eligible for benefits and other compensation

Responsibilities

  • In this role, you will drive software bring-up, performance analysis, and optimization for multiple generations of AI accelerators, working across the full stack from low-level kernels and compiler/runtime integration to distributed training, inference serving, networking, and fleet-scale system behavior

  • You will develop strategies that improve the correctness, efficiency, reliability, and scalability of real-world AI workloads, including deep analysis of training and inference runs to validate numerical behavior, identify bottlenecks, and guide architectural tradeoffs

  • You will collaborate closely with architecture, microarchitecture, compiler, runtime, networking, and systems teams to translate workload insights into practical system designs that enable efficient large-scale AI deployment

Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft's cloud growth?

Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy -

Microsoft's mission is to empower every person and every organization on the planet to achieve more.

As employees, we come together