Software Engineer II - AI Infrastructure

Share job

Are you a software engineer whose interests are in system architecture with a bias for innovation and product making? Join our dynamic Packaging and Content (PAC) team within the Experiences + Devices (E+D) organization, where you'll have the autonomy to be creative, explore AI-oriented solutions, and drive impactful internal systems solutions with broad reach across the company. If you're excited about influencing the future through your innovations and thrive in a culture that values respect, integrity, and accountability, we want to hear from you!

We are seeking a Software Engineer II - AI Infrastructure to architect and design systems to scale the PAC team’s internal tools capabilities. The ideal candidate will be organized, adaptable, and capable of performing multiple functions in designing, developing, evolving, and maintaining a robust and secure systems architecture. Key responsibilities include overseeing the internal PAC tools and systems architecture, designing technical solutions and implementing best practices for functionality enhancement, performing and driving prioritized development work, and enabling team productivity through AI integration and automation workflows all within a secure and compliant infrastructure.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 1+ years experience with technology architectures and solutions utilizing the Microsoft Azure stack which includes, but not limited to: Microsoft Entra ID authentication, App Services, Functions, Event Hubs, Stream Analytics, Azure DevOps, Dynamics 365, Power Platform, Visual Studio, .NET, GitHub, Microsoft Fabric
  • OR equivalent experience.
• 1+ years experience in hardware acceleration of AI/ML models.
• 1+ years experience in deep learning frameworks and tensor libraries like PyTorch, Tensorflow, JAX/FLAX.

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Additional or Preferred Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  
  • OR Master's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    
  • OR equivalent experience.
• 1+ years experience with Security Development Lifecycle (SDL), security assessments, and threat models to identify vulnerabilities and propose mitigation strategies.
• Familiarity with AI Tools and the ablity to create and utlize AI Agents to aguments process and procdures to increase team productivity.

• Familiarity with building ML applications, LLM serving, GPU serving.

• Familiarity with containers and container orchestration systems.

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until June 14, 2025.

#W+Djobs

• Define AI Infrastructure and the future of AI Platforms to accelerate the PAC team’s AI productivity
• System Architecture optimized for AI: Create and maintain a robust and secure system architecture that leverages the Microsoft stack, optimizes for AI, and minimizes dependencies on 3rd party software and systems. Contribute to technical discussions and help drive architectural decisions to support long-term scalability and maintainability. Rationalize existing tools and systems, and where necessary, upgrade solutions to simplified, consistent, modern engineering & security protocols.
• Solutions Design and Development: Apply best practices in software engineering, including code reviews, testing, and continuous integration and deployment. Architect intuitive D365 solutions, APIs, integrations, SDKs, and extensibility layers that eliminate manual processes, optimize workflow efficiencies, and expand data insights to the benefit of internal PAC team workflows and operations. Operationalize a closed-loop system where insights from Fabric, and first-party data drive process optimization.
• Development Operations: Define, implement, and manage a best practice framework of DevOps processes & technologies to ensure systems evolve and are proactively maintained. Maintain tools roadmap, develop functional and design specifications, build, test, and execute scalable solutions. Optimize use of vendor resources to deliver high impact features. Create and maintain technical documentation, ensuring knowledge sharing and best practices are followed across the team. Ensure reliability of apps and services through intelligent, proactive performance monitoring and alerting. Provide technical leadership across features, projects and tools driving consistency in monitoring and operations at scale.
• Security and Compliance: Ensure predictable processes are followed to achieve a high degree of security, privacy, safety, and accessibility. Check for visible evidence to demonstrate compliance and ensure onboarding new technologies meets compliance at Microsoft. Influence cross-functional teams and drive risk mitigations, ensuring security priorities align with broader organization’s engineering & security roadmaps. Adapt to changes in security and compliance, ensuring that the system architecture quickly adopts policies and maintains a standard of 100% compliance. Maintain & measure security through Azure Service Tree/S360 maintenance, design reviews, threat modeling, accessibility, and other compliance processes. Lead security threat modeling and risk analysis efforts, mapping risks to security controls and architectural improvements. Ensure internal system/security controls and measures extend to dependent supplier systems’ security, confidentiality, and integrity. Utilize Identity and Access Management and Security Graph insights to analyze relationships between services, identify vulnerabilities, and prioritize security investments.
• Evolve through AI & Innovation: Monitor and adapt to emerging tools, AI advancements, and content governance trends to future-proof tools solutions and operations. Execute AI solutions that measurably improve team workflows, enhance PAC productivity, and align with the wider organization. Boost team productivity and support the growing use of autonomous & multi-agent workflows by creating an agent management framework in AI Foundry. Implement workflow automations and AI-assisted applications / agents to reduce labor efforts and maximize resource efficiency.
• Technical Leadership and Collaboration: Work closely with cross-functional PAC teams, and broader Microsoft and E+D engineering teams, to ensure new tools & feature development is successfully implemented and can be easily maintained within the existing system architecture and team resourcing levels. Collaborate with penetration teams, senior service architects, and security engineers to identify actionable system improvements. Provide technical guidance and support to extended PAC Tools team, including vendor developers and testers.