The enterprise data lake: monitoring at scale

When data lakes grow, they grow in size, complexity and inhabitants - creating complex dependencies across wide ranges of Azure services and different teams. Creating a true operations challenge: how do you find and respond to incidents, and who should respond?

During this session, we’ll look at how to monitor across the boundaries of Azure services and development teams that together make the ecosystem of the data lake. Aided by the Four Golden Signals and Azure Monitor capabilities we’ll create the blueprint for effective monitoring and incident handling. No matter how big the lake.

Martijn Beenker

Martijn Beenker

data engineer @ Avanade

Other sessions from: Sessions

Azure Cloud Transformation done right

Azure Cloud Transformation done right

The past years we have been involved in many so-called cloud transformation...

Marcel de Vries Marcel de Vries
Empowering ARM and JSON with Project 'Bicep'

Empowering ARM and JSON with Project 'Bicep'

70% of all declarative resources created in Azure are done via ARM Templa...

Esther Barthel Esther Barthel
Freek Berson Freek Berson
Terraforming the Cloud: A guide to using Terraform to control cloud deployments

Terraforming the Cloud: A guide to using Terraform to control cloud deployments

Azure provides us with many ways to deploy our workloads, but how can we do...

Anna-Maria Wykes Anna-Maria Wykes
Introduction to WVD and how to use Azure DevOps for Image

Introduction to WVD and how to use Azure DevOps for Image

Quick introduction to WVD and how to use Azure DevOps for Image and Sof...

Stefan Dingemanse Stefan Dingemanse
 Jordi van Drunen Jordi van Drunen
“Getting rid of silo’s!”, “…embracing the MLOps…”, “….democratize data…”, it all sounds very catchy but how do you actually do it?

“Getting rid of silo’s!”, “…embracing the MLOps…”, “….democratize data…”, it all sounds very catchy but how do you actually do it?

Having come across of many examples, especially within the financial sector...

Frank Buters Frank Buters
Best practices to deploying mern stack applications on azure

Best practices to deploying mern stack applications on azure

As an engineer, it never ends with development. Deployment is always part...

Dawuda Iddrisu Dawuda Iddrisu
Kati Frantz Kati Frantz