Principal Enterprise QA Architect, AI Health Cloud

BrightSpring Health Services

We are seeking a highly experienced Principal Enterprise QA Architect to define and lead the quality strategy for our AI Health Cloud platform. This is a senior leadership role responsible for architecting enterprise-wide quality engineering, test automation, and validation frameworks across AI/ML platforms, healthcare data pipelines, and cloud-native applications.

You will operate at the intersection of platform architecture, AI/ML systems, and healthcare compliance, ensuring that all solutions-from APIs and microservices to LLM-powered workflows-are highly reliable, secure, explainable, and production-ready.

This role extends beyond traditional QA into Quality Engineering, AI validation, and continuous verification at scale.

Define and lead end-to-end quality architecture across platform, data, AI/ML, and applications
• Establish enterprise QA standards, frameworks, and governance models
• Design validation strategies for LLMs, RAG pipelines, vector databases, and agent systems
• Architect testing strategies for microservices, APIs, and distributed systems
• Lead development of enterprise automation frameworks
• Ensure compliance with HIPAA, CMS, NCQA and security standards
• Collaborate with architects, product, and engineering teams
• Implement observability-driven quality and continuous improvement

• 15+ years in QA, Quality Engineering, or Test Architecture
• Strong experience in cloud-native systems and automation frameworks
• Experience with AI/ML validation and testing
• Deep knowledge of healthcare data and interoperability standards
• Expertise in DevOps, CI/CD, and MLOps
• Strong leadership and stakeholder management

Preferred Qualifications

• Experience with LLM validation and Responsible AI
• Familiarity with RAG, vector databases, and agent frameworks
• Experience in healthcare quality programs (HEDIS, Stars)
• Advanced degree in relevant field

Success Metrics

• Platform reliability and defect reduction
• Improved AI model trust and performance
• Increased automation coverage and faster releases
• Strong regulatory compliance

Why Join Us

• Lead the future of AI quality in healthcare
• Work with top-tier engineers, clinicians, and AI teams
• Solve complex AI safety and compliance challenges
• Competitive compensation and flexible work environment