Senior Business Intelligence Engineer

Share job

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

The mission of Microsoft Digital Security & Resilience (DSR) is to enable Microsoft to build the most trusted devices and services, while keeping our company safe and our data protected. As part of the Microsoft Security organization, and a steward of Microsoft and our customer’s data, a core function of Microsoft DSR is ensuring the security of every aspect of the business. Microsoft DSR is responsible for company-wide information security and compliance, with a strategic focus on information protection, assessment, awareness, governance, and enterprise business continuity. As customer zero, we deploy and secure these services inside Microsoft and then share best practices with enterprise customers at scale across the globe. We have exciting opportunities for you to innovate, influence, transform, inspire and grow within our organization and we encourage you to apply to learn more!

Are you passionate about the idea of protecting over a billion people and making the world a durably safer place? The Microsoft Security Response Center (MSRC) is on the forefront of protecting the breadth of Microsoft’s customers from emerging threats to security and privacy.

The MSRC Data Science team is responsible in building Business Intelligence on core security issues using data pipelines, data mining, ETL, dashboards and insights on security related data. We combine our data science work with business and engineering knowledge to provide unique insights into customer scenarios that are leading the data-driven culture within security.

We are looking for a Senior Data Engineer to partner with a wide range of Engineers, PMs, and Security PMs, build and deliver solutions using Data Engineering with Kusto, DAX and build PowerBI dashboards. Not limited to the mentioned problem space, this person should be able to own one or more areas of opportunities and identify Business or Engineering problems, dig out sources of data, conduct the analysis that would reveal useful insights, and build data driven insights, KPIs for Monthly Business Reviews for Senior leadership and Operational reporting. We are looking for someone who has hands-on experience in these areas and have an ability to quickly understand the business areas to help build mission critical dashboards.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Required Qualifications

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

• OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
• OR equivalent experience.

• 3+ years’ experience in building data pipelines, ETL using cloud computing like, Kusto (Azure Data Explorer), Azure Key Vault, Azure Storage or similar.
• 3+ years experience building KPIs and dashboards using DAX and PowerBI.

Preferred Qualifications

· Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)

• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
• OR equivalent experience.

· 3+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).

· Experience presenting at conferences or other events in the outside research/industry community as an invited speaker.

· 3+ years experience conducting research as part of a research program (in academic or industry settings).

· 1+ year(s) experience developing and deploying live production systems, as part of a product team.

· 1+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shippin

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until March 20, 2025

#BusinessIntelligence #BI #DataEngineering #PowerBI #Reporting #Kusto #AzureDataExplorer #DAX #MSFTSecurity #MSRC #MSFTSecurity

Bringing the State of the Art to Products

· Establishes collaborative relationships with relevant product and business groups inside or outside of Microsoft and provides expertise or technology to create business impact. Takes initiative and drives activities such as technology transfers attempts, standards organizations, filing patents, authoring white papers, developing or maintaining tools/services for internal Microsoft use, or consulting for product or business groups. May publish research to promote receiving new intellectual property for business impact.

· Brings new technology and approaches into production by applying long-term research efforts to solve immediate product needs. Collaborates with and bridges the gap between researchers (in community across the company, Microsoft Research [MSR], or in their own organizations) and development teams. Begins to negotiate across teams to ensure cutting edge technology is being applied to products in a practical way that meets key business objectives. Develops an understanding of research approaches used across a group or organization to leverage (and not re-invent) solutions.

· Independently works to create product impact. Identifies approach, and applies, improves, or creates a research-backed solution (e.g., novel, data driven, scalable, extendable) to positively impact a Microsoft product or service. Designs an approach to solve significant business problems shared by a senior team member. May publish research to promote receiving new intellectual property for product impact.

Leveraging Applied Research

· Masters one or more subareas (e.g., Object Recognition, Text Classification) and gains expertise in a broad area of research (e.g., Machine Learning, Natural Language Processing, Computer Vision, Statistical Modeling, Data-Driven Insights. Understands the corresponding literature and applicable research techniques. Uses expertise to identify the right technique to use when examining a problem.

· Serves as an expert within product domain. Gains deep knowledge in a complex or highly ambiguous service, platform, or domain. Shares knowledge of changes in industry trends and advances in applied technologies with engineers and product teams to apply advanced concepts to identify product needs and drive action toward solutions. Fosters audience for the product based on understanding of the industry.

· Reviews business and product requirements and incorporates state-of-the-art research or previously tested solutions occurring at Microsoft and the academic field to formulate plans that will meet business goals. Identifies problems and develops strategy to resolve team or feature level problems. Provides strategic direction for the kinds of data used to solve problems.

· Researches and develops an understanding of tools, technologies, and methods being used in the community that can be utilized to improve product quality, performance, or efficiency. Applies deep subject matter expert knowledge around several specialized tools/methods to support business impact.

Capability Management and Networking

· Provides mentorship by participating in onboarding to less experienced team members (e.g., interns, research associates) and guiding less experienced team members in processes, scenarios, projects, and their careers, and provides guidance around best practices and standards. Assists in developing academics to be members of multi-discipline teams.

· Identifies and inspires peers and new research talent to join Microsoft. Participates in candidate screening and interviewing and forms job descriptions for attracting new talent. May share research findings through publications or industry outreach. Collaborates with the academic community to develop the recruiting pipeline, identify cutting-edge solutions for products, and establish awareness of their work.

Documentation

· Performs documentation of work in progress, experimentation results, plans, etc. Documents scientific work to ensure process is captured. Creates informal documentation and may share findings to promote innovation within group or with other groups.

Ethics and Privacy

· Uses deep understanding of fairness and bias. May contribute to ethics and privacy policies related to research processes and/or data/information collection by providing updates and suggestions around internal best practices. Seeks to identify potential bias in the development of products.

Specialty Responsibilities

· Leverages data analysis knowledge to clean, transform, analyze, integrate, and organize data to the level required by the analysis techniques selected. Develops useable datasets for modeling purposes. Scales the feature ideation and data preparation. Takes cleaned or raw data and adapts data that for machine learning purposes. Uses understanding of which features are important that come out of the model and identifies the optimal features. Identifies gaps in current datasets and drives onboarding of new datasets. Works with team to optimize signal system design. Mentors and coaches less experienced members in data cleaning and analysis best practices. Identifies gaps in current datasets and drives onboarding of new datasets (e.g., bringing on third-party datasets). Attempts to fix bugs in data to inform developers how to improve the products. Ensures representative data to honor problem definition and ethics.*

· Leverages or designs and uses machine learning/data extraction, transformation, and loading (ETL) pipelines (e.g., data collection, cleaning) based on data prepared and guides team to do so. Influences the direction of the team. Establishes the pipeline so that the team can conduct all of their experiments and data processing. Provides guidance to less experienced team members. Uses data pipelines for training, as well as for shipping models which should execute correctly.*

· Collaborates with others and helps lead others to leverage data to identify pockets of opportunity to create state-of-the-art algorithms to improve a solution to a business problem. Consistently leverages knowledge of techniques to optimal analysis using algorithms. Identifies opportunity areas regarding new statistical analyses and drives solutions. Uses statistical analysis tools or modifies existing tools for evaluating Machine Learning models and validates assumptions

about the data while also reviewing consistency against other sources. Runs basic descriptive, diagnostic, predictive, and prescriptive statistics. Represents the team's insights. Characterizes the customer's problem through metrics to measure the quality of machine learning systems. Calibrates metrics to support decision making for data (e.g., gaining awareness of ideal metrics and use of metrics).*

· Identifies possible machine learning formulations that map to the problem and selects the formulation that gives the optimal outcome (e.g., predicting the actual age or age group). Leverages state-of-the-art algorithms that structures, analyzes, and uses data in products and platforms to train algorithms scalable for artificial intelligence solutions before deploying. Uses familiarity of machine learning frameworks (e.g., uses open source libraries) to train algorithms. Collaborates and helps less experienced team members through process.*

· Helps address scalability problems by adjusting to stakeholder needs. Works with large-scale computing frameworks, data analysis systems, and modeling environments to improve models. Applies the model to real products, and then verifies effects through iterations. Experiments by putting multiple models in production and evaluating their performance. Mentors less experienced team members through modeling processes. Continues to monitor how algorithm performs against expected behaviors and performance or accuracy guardrails. Monitors over time for input and output data that there are changes over time. Uses system to run analyses on an ongoing basis such as by comparing predicted value with actual value. Addresses models that break during production (e.g., due to input streams changing).*

Other : Embody our Culture and Values

*Note. It was determined that requirements differed among employees in the Machine Learning specialization/role. These differences are noted where relevant.