The enterprise data lake: monitoring at scale

When data lakes grow, they grow in size, complexity and inhabitants - creating complex dependencies across wide ranges of Azure services and different teams. Creating a true operations challenge: how do you find and respond to incidents, and who should respond?

During this session, we’ll look at how to monitor across the boundaries of Azure services and development teams that together make the ecosystem of the data lake. Aided by the Four Golden Signals and Azure Monitor capabilities we’ll create the blueprint for effective monitoring and incident handling. No matter how big the lake.

Martijn Beenker

Martijn Beenker

data engineer @ Avanade

Other sessions from: Sessions

Azure Service Bus at scale, lessons from the production trenches

Azure Service Bus at scale, lessons from the production trenches

In this talk, we’ll focus on Microsoft’s Azure Service Bus message broker....

Merlin Bieze Merlin Bieze
Solving real world problems using ML.Net and Azure IoT edge

Solving real world problems using ML.Net and Azure IoT edge

Life is strange for IoT devices. They are 'born' in the outside world all...

Sander van de Velde Sander van de Velde
Blogging with Markdown and Azure DevOps

Blogging with Markdown and Azure DevOps

Explaining the basics of markdown, and then show how you can build a static...

Andre van den Berg Andre van den Berg
Unlocking the power of data

Unlocking the power of data

Today’s business environment is evolving at an unprecedented rate. Keeping...

Rohan Kumar Rohan Kumar
The Azure Bakery

The Azure Bakery

Welcome to 'The Azure Bakery.' In this talk, we'll bake a delicious layered...

Robin Smorenburg Robin Smorenburg
Azure Container Apps

Azure Container Apps

At Ignite, Microsoft announced Azure Container Apps, a serverless applica...

Kendall Roden Kendall Roden