New 
Senior Technical Program Manager, AI Evaluation and Experimentation
 Microsoft | |
 United States, Texas, Irving | |
| 7000 State Highway 161 (Show on map) | |
 Nov 02, 2025 | |
|
OverviewWith more than 45,000 employees and partners worldwide, the Customer Experience and Success (CE&S) organization is on a mission to empower customers to accelerate business value through differentiated customer experiences that leverage Microsoft's products and services, ignited by our people and culture. We drive cross-company alignment and execution, ensuring that we consistently exceed customers' expectations in every interaction, whether in-product, digital, or human-centered. CE&S is responsible for all up services across the company, including consulting, customer success, and support across Microsoft's portfolio of solutions and products. Join CE&S and help us accelerate AI transformation for our customers and the world. The Strategy and Operations (S&O) team is dedicated to drivingstrategicvision and operational excellence across CE&S. We aim to enhance our company's edge byleveragingmarket insights, fostering innovation, and ensuring seamless execution of strategic initiatives. The Technical Program Manager (TPM) will establish and lead the evaluation, testing, and experimentation function for AI solutions across Customer Experience & Success (CE&S). This role is responsible for defining the strategic vision, building technical blueprint and proving 0->1 motions, influencing technical roadmaps, and driving cross-functional execution to ensure AI programs deliver reliable, scalable, and responsible value.The Senior Technical Program Manager-AI Evaluation and Experimentation will implement a unified framework for comprehensive evaluation, rigorous testing, and safe experimentation, working closely with engineering, data science, business, and governance teams. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
ResponsibilitiesTechnical Architecture LeadershipCollaborate with various technical team to validate that technical architecture standards for AI/ML systems across multiple projects to take into account the quality and resilience. AI Evaluation & Quality AssuranceEstablish scalable quality assurance patterns for model deployment and integrationDevelop and maintain frameworks for model performance, fairness, and robustness evaluation.Implement quality gates and continuous testing pipelines for AI components.Lifecycle OptimizationDrive development velocity through streamlined processes and MLOps best practices.Monitor and optimize workflows to balance speed with compliance and risk mitigation.Governance & Risk ManagementTranslate responsible AI principles into actionable technical controls.Ensure adherence to security, privacy, and ethical standards throughout the lifecycle.Support various Agent-building teams with guidance on RAI standards. Cross-Functional CollaborationPartner with solution designers and product teams to align technical execution with business goals.Provide technical guidance to cross-functional teams and stakeholders. Other Embody our culture and values. | |