Workshop Delta Lake Sharing - Databricks - Nov 4

Workshop Delta Lake Sharing – Databricks – Nov 4

November 4, 2021 / 8:15 am - 10:15 am

In May of this year, Databricks released Delta Sharing, an open protocol for the secure exchange of massive datasets. Through the generation of pre-signed, short-lived URLs pointing directly at requested data, and their distribution to authenticated data consumers, Delta Sharing facilitates real-time, platform-agnostic access to an organization’s information. This makes Delta Sharing well-suited as a means to inter-domain dataset distribution in the Data Mesh. Data Mesh is an architectural paradigm that erupted into the public consciousness at around the same time. This code breakfast consists of two parts.

Schedule

8:15 am

Data requests via Delta Sharing

In part one, Kris Geusebroek will introduce you to the details of the Delta Sharing protocol and perform a live demonstration of a data request via the protocol using Apache Spark.

Host

Kris Geusebroek Data Engineer at GoDataDriven

9:15 am

Introduction to Data Mesh

In part two, Robert Rodger will give a brief introduction to the Data Mesh concept and describe the role Delta Sharing can play in it.

Host

Robert Rodger Data Scientist at GoDataDriven