Principal Product Manager, Azure OpenAI & Cognitive Services

About Microsoft Azure

Microsoft's mission is to empower every person and every organization on the planet to achieve more. In Azure AI, we provide enterprise-grade access to cutting-edge generative AI models, backed by Microsoft's enterprise governance, compliance, and hyper-scale cloud infrastructure.

Role Overview

We are seeking a seasoned Principal Product Manager to own the developer and enterprise platform experience for Azure OpenAI Service. You will drive product strategy for high-performance API endpoints, provisioned throughput units (PTU), enterprise data boundary protections, and agentic orchestration frameworks.

Key Responsibilities

• Define and execute the multi-year product roadmap for Azure OpenAI foundational model hosting and enterprise APIs.
• Analyze customer requirements across Fortune 100 enterprises to prioritize features around fine-tuning, latency SLAs, and compliance certifications (HIPAA, SOC 2, FedRAMP).
• Partner closely with engineering, research, and infrastructure teams to maximize GPU fleet efficiency and optimize pricing structures.
• Collaborate with Microsoft Copilot teams to dogfood new capabilities and create seamless enterprise deployment experiences.
• Represent Azure AI at premier global conferences, customer advisory boards, and executive briefings.

Qualifications & Experience

• 8+ years of product management experience shipping cloud infrastructure, developer APIs, or enterprise software products.
• Strong technical depth with understanding of LLM serving dynamics, token generation metrics, and cloud architectures.
• Demonstrated track record of transforming ambiguous customer needs into high-adoption, revenue-generating product features.
• Exceptional cross-functional leadership and executive presence.

Compensation & Total Rewards

• Base Salary: $205,000 – $315,000 per year + annual cash bonus + Microsoft Stock Award (RSUs).
• Industry-leading 401(k) 50% match on all employee contributions up to IRS limit.
• Extensive health, wellness, and mental health benefits with on-site Redmond campus amenities.
• Comprehensive parental and caregiver leave programs.