Senior Product Manager - Copilot Measurement & Evaluation

Share job

As Microsoft AI we are pushing the boundaries of technology.

We are creating unique, beautiful and powerful products that will change lives. A small, friendly, fast-moving team, we support each other to do the best work of our lives, always looking to break new ground, fast. We are proud of what we build, how we build it and that our products will define the AI era. We run lean, obsess about users, and always make our decisions based on the evidence. We ship regularly, so your work will have real and immediate impact. It’s a time of huge change in the AI landscape, and this role will put you right in the heart of it.

We’re on the lookout for a data-driven Product Manager (PM) to help build the next wave of capabilities of our personal AI, Copilot. As an experienced Product Manager for Measurement and Evaluation on the Copilot team, you will balance creativity, curiosity, technical expertise, to drive challenging projects to successful completion. You will collaboratively work with data scientists, AI researchers, engineers, designers, and product managers to take ambiguous projects and mold them into amazing experiences to delight our customers. We’re looking for someone with a strong technical depth, an abundance of positive energy, empathy, and kindness, in addition to being highly effective. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.

Our newly formed organization, Microsoft AI (MAI), focuses on Copilot and other consumer AI products and research. We combine world-class AI research together with top notch design and product craft. The wider team is responsible for Copilot, Bing, Edge, and generative AI research, while the Mobile Engineering team is responsible for leading and building the mobile experience of Copilot on iOS and Android, collaborating closely with our Product Management, Design and AI

Research teams. This role requires a balance of technical skills and effective people management skills.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. Mountain View, CA, you are required to be local to the San Francisco area and in office 3 days a week.

Required Qualifications:

• Bachelor's Degree AND 5+ years experience in product management
  • OR equivalent experience.
• Experience building product roadmaps for user facing products.

Preferred Qualifications:

• Bachelor's Degree AND 7+ years of experience in product management
  • OR equivalent experience.
• Technical expertise, previous experience in quantitative or technical roles (Data Scientist, ML Engineer, Product Analyst, etc.)
• Experience leading product teams building consumer products in AI, personal productivity, search, education or messaging.
• Experience building consumer products leveraging Machine Learning or Large Language Models.
• Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
• Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
• Experience with data analytics and experimentation tools. Working knowledge of SQL and coding skills (Python, JavaScript).

Product Management IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year. Certain roles may be eligible for benefits and other compensation.

Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until December 20, 2024.

#COPILOT

• Define the Product Roadmap: Build the product roadmap and strategic direction for the Copilot Data Science team responsible for measuring, evaluating and understanding Copilot: from the model performance to the user behaviors.
• Spin the Data Flywheel: Extract data insights from billions of data points to uncover issues and opportunities and share recommendations to lead to direct product improvements. Work with AI teams to transform learnings into direct model improvements.
• Orient the Success Metrics: Influence our NorthStar metrics (successful sessions, active users, revenue, etc.) and how we measure the success of Copilot.
• Evangelize learnings to drive impact: Share Data Science and Product Analytics Insights in Weekly Product Reviews and Team All Hands.
• Orient the overall Copilot product strategy: Use metrics and insights to influence the broader Copilot product roadmap.
• Embody our culture and values.