The enterprise data lake: monitoring at scale

When data lakes grow, they grow in size, complexity and inhabitants - creating complex dependencies across wide ranges of Azure services and different teams. Creating a true operations challenge: how do you find and respond to incidents, and who should respond?

During this session, we’ll look at how to monitor across the boundaries of Azure services and development teams that together make the ecosystem of the data lake. Aided by the Four Golden Signals and Azure Monitor capabilities we’ll create the blueprint for effective monitoring and incident handling. No matter how big the lake.

Martijn Beenker

Martijn Beenker

data engineer @ Avanade

Other sessions from: Sessions

Blogging with Markdown and Azure DevOps
Blogging with Markdown and Azure DevOps

Explaining the basics of markdown, and then show how you can build a static...

Andre van den Berg Andre van den Berg
Programming for Accessibility
Programming for Accessibility

Building accessibility into the planning stages of programming can elimina...

Rory Preddy Rory Preddy
All about Azure Network Securities
All about Azure Network Securities

In this session am going to explain how to implement network securities in...

Menaka Baskerpillai Menaka Baskerpillai
Unlocking the power of data
Unlocking the power of data

Today’s business environment is evolving at an unprecedented rate. Keeping...

Rohan Kumar Rohan Kumar
Teams + Power BI a match made in heaven
Teams + Power BI a match made in heaven

Data is everywhere, and so is Teams. So why don't we combine the two and...

Ida Bergum Ida Bergum
Empowering ARM and JSON with Project 'Bicep'
Empowering ARM and JSON with Project 'Bicep'

70% of all declarative resources created in Azure are done via ARM Templa...

Esther Barthel Esther Barthel
Freek Berson Freek Berson