Senior Data Engineer

Share job

Microsoft Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft's cloud services and our team is focused on delivering high quality infrastructure to support cloud operations. As Microsoft’s Cloud business continues to mature, our infrastructure expansion accelerates, and Data Centers are central to this growth. To support this, the acquisition and development of our owned, designed, and constructed Data Center facilities will scale to meet the demands of our customers, while we also continue to lease and acquire Data Center capacity at pace, particularly in our high growth markets, working closely with Data Center operators in each region, and across the Globe.

We are seeking a skilled Data Engineer to join our COI+I Lease and Land Development Digital Transformation team. The ideal candidate will have a robust background in data management, algorithm design, and analytical skills to drive the development and optimization of our systems and tools. This role will involve transforming raw data into valuable insights, designing efficient data architectures, and ensuring compliance with data governance standards.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Required/Minimum Qualifications:

• Bachelor’s degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years’ experience in business analytics, data science, data modeling, or data engineering work
  • OR Master’s degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field and 3+ years’ experience in business analytics, data science, data modeling, or data engineering work
  • OR equivalent experience.
• 4+ years of experience in developing solutions with Microsoft Power Platform, including Power BI, Fabric, Power Automate & M365 Dataverse.
• 3+ years of experience in building Data Pipelines using Azure Data Factory.
• 1+ year of experience in developing solutions in Azure Fabric.
• 4+ years of experience in writing SQL Queries.
• 1+ years of experience with data cloud computing technologies such as – Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/Additional Qualications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering , or related field AND 8+ years experience in business analytics, data science, software development, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years of business analytics, data science, software development, data modeling or data engineering work experience
  • OR equivalent experience.
• 8+ years of experience in data engineering with proven coding and debugging skills in C#, Python, and/or SQL.
• Creative problem-solving & analytical skills to drive keen insights and identification of opportunities combined with a “sense of urgency” to develop solutions.
• Experience deploying solutions in Azure Services & Managing Azure Subscriptions.
• Experience with big data and writing queries with Kusto/KQL.
• Experience extracting data via REST APIs.
• Excellent analytical skills with a systematic and structured approach to software design

Data Engineering IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until January 2, 2025.

#COICareers

• Data Management and Transformation: Apply modification techniques to transform raw data into compatible formats for downstream systems. Utilize software and computing tools to ensure data quality and completeness. Implement code to extract and validate raw data from upstream sources, ensuring accuracy and reliability.
• Data Requirements and Modeling: Collaborate with stakeholders to document and understand data requirements. Evaluate project plans to assess data costs, access, and availability. Draft design specifications to model data flow and storage, ensuring data is easy to connect and manage.
• Compliance: Adhere to data modeling and handling procedures to maintain compliance with laws and policies. Document data type, classifications, and lineage to ensure traceability and govern data accessibility.
• Engineering Fundamentals: Perform root cause analysis to identify and resolve anomalies. Implement performance monitoring protocols and build visualizations to monitor data quality and pipeline health. Support and monitor data platforms to ensure optimal performance and compliance with service level agreements.
• Data Engineering, insights generation, and analytics with deep domain knowledge understanding.
• Implement code to extract raw data, validate its quality, and ensure the correct data is ingested within your area of work after cooking, data transformation.
• Follow data modeling and handling procedures to maintain compliance with all applicable laws and policies across your assigned workstreams.
• Develop and implement solutions for data quality validation and continuous improvement.
• Manage, execute, and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
• Partner with data scientists, PMs, engineers, and business stakeholders globally to understand business and technical requirements, plan and execute projects, and communicate status, risks, and issues.
• Design and Implement Dashboards: Develop user-friendly dashboards for various applications, such as Supplier Spend Analytics, Supplier Scorecards, Incident and Service Level Agreement (SLA) Compliance Monitoring, Spares and Inventory Management, and other business-facing applications.