Workshop Delta Lake Sharing – Databricks
November 4, 2021
In May of this year, Databricks released Delta Sharing, an open protocol for the secure exchange of massive datasets. Through the generation of pre-signed, short-lived URLs pointing directly at requested data, and their distribution to authenticated data consumers, Delta Sharing facilitates real-time, platform-agnostic access to an organization’s information. This makes Delta Sharing well-suited as a means to inter-domain dataset distribution in the Data Mesh. Data Mesh is an architectural paradigm that erupted into the public consciousness at around the same time. This code breakfast consists of two parts.