Principal Software Engineer (Web Data Platform)

Share job

We are looking for a talented and experienced platform developer to join Bing Crawler team in MAI Web Data Platform org. The Microsoft AI (MAI) builds comprehensive and engaging content, services, and platforms for consumers to access the information they need anywhere on any device and for enterprises to enhance their employee and customer experiences. At Web Data Platform Team, we build the global web scale Index and the platform that supports it.

You will be responsible for designing, developing and improving the architecture and codebase of our large-scale web crawler platform system, which fetch, render, process, and store billions of web pages every day. You will also have the opportunity to mentor a team of software engineers, drive technical innovation and decisions, and collaborate with other teams across Bing and Microsoft.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Required qualifications:
- BS degree in computer science, engineering, mathematics or related fields.
- 7+ years of professional software development experience.
- Proficiency in at least one high-level programming language including but not limited to: C++, C#, Java, Golang or Rust.
- Good communication, collaboration and problem-solving skills.
- Fluent English speaking and writing.

Preferred Qualifications
- Experience of large-scale distributed system
- Familiarity with online service high performance tuning
- Familiarity with large-scale data processing and storage
- Nice to have crawling system experience
- Nice to have search engine platform development experience
- Nice to have machine learning project experience

- Design the architecture of Crawler system, ensuring scalability, efficiency, performance and quality.
- Implement features in a distributed and scalable environment using data to guide and measure success.
- Develop and execute unit, integration, and performance tests to ensure the system is reliable, robust, and meets quality standards.
- Debug and mitigate incidents in live production environments.
- Stay up to date with the latest industry trends and technologies and proactively suggest improvements to the existing system.
- Collaborate closely with cross-functional teams, including product managers and other engineers, to align development goals with business objectives.