New 
Principal Software Engineering Manager - CoreAI
 Microsoft | |
 United States, Washington, Redmond | |
 Sep 12, 2025 | |
|
OverviewCoreAI is at the heart of Microsoft's mission to revolutionize how software is built and experienced. We build the foundational platforms, services, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. The Inferencing Control Plane team is responsible for building the distributed systems and orchestration frameworks that manage the lifecycle, routing, and execution of AI workloads at scale. We provide the critical infrastructure that ensures reliable, performant, and secure inferencing across heterogeneous environments and models. This Principal Software Engineering Manager - CoreAI role is a unique opportunity to lead a team building the backbone of generative AI infrastructure at Microsoft!
ResponsibilitiesLead and grow a team of software engineers focused on building scalable, cloud-native inferencing services and orchestration layers.Partner with product, research, and platform teams to define requirements and deliver robust, extensible infrastructure platforms and product APIs.Drive architectural decisions and technical strategy for inferencing control systems, ensuring high availability, performance, and cost efficiency.Guide the team in designing and implementing distributed systems that support dynamic routing, load balancing, and execution of AI workloads.Ensure engineering excellence through code reviews, design reviews, and mentoring, fostering a culture of innovation and inclusion.Own the operational health of services, including on-call rotations, incident response, and continuous improvement of reliability metrics.Collaborate across CoreAI and Microsoft to align on platform integration, security, and compliance requirements.Champion developer experience and usability in SDKs and tooling, enabling seamless integration with agentic and generative AI platforms. | |