The enterprise data lake: monitoring at scale

When data lakes grow, they grow in size, complexity and inhabitants - creating complex dependencies across wide ranges of Azure services and different teams. Creating a true operations challenge: how do you find and respond to incidents, and who should respond?

During this session, we’ll look at how to monitor across the boundaries of Azure services and development teams that together make the ecosystem of the data lake. Aided by the Four Golden Signals and Azure Monitor capabilities we’ll create the blueprint for effective monitoring and incident handling. No matter how big the lake.

Martijn Beenker

Martijn Beenker

data engineer @ Avanade

Other sessions from: Sessions

All about Azure Network Securities

All about Azure Network Securities

In this session am going to explain how to implement network securities in...

Menaka Baskerpillai Menaka Baskerpillai
Unlocking the power of data

Unlocking the power of data

Today’s business environment is evolving at an unprecedented rate. Keeping...

Rohan Kumar Rohan Kumar
Solving real world problems using ML.Net and Azure IoT edge

Solving real world problems using ML.Net and Azure IoT edge

Life is strange for IoT devices. They are 'born' in the outside world all...

Sander van de Velde Sander van de Velde
Best practices to deploying mern stack applications on azure

Best practices to deploying mern stack applications on azure

As an engineer, it never ends with development. Deployment is always part...

Dawuda Iddrisu Dawuda Iddrisu
Kati Frantz Kati Frantz
Empowering ARM and JSON with Project 'Bicep'

Empowering ARM and JSON with Project 'Bicep'

70% of all declarative resources created in Azure are done via ARM Templa...

Esther Barthel Esther Barthel
Freek Berson Freek Berson
Monitoring & Debugging Distributed Systems in Azure

Monitoring & Debugging Distributed Systems in Azure

The development of containers and container orchestrator has made it easier...

Yusuf Yusuf Yusuf Yusuf