Databricks has introduced OpenSharing, a new protocol designed to replace traditional file and API data feeds with a more efficient method for sharing data. OpenSharing allows recipients to read data directly from a provider's Delta table in real-time, eliminating the need for manual export jobs, file tracking, and duplicate data storage. This approach simplifies data ingestion for recipients by enabling them to access changes as a live stream or through a change data feed, while also reducing the maintenance overhead for providers. AI
IMPACT Simplifies data ingestion and sharing, reducing costs and complexity associated with traditional data pipelines.
RANK_REASON The article describes a new protocol and its implementation for data sharing, which is a product/tooling improvement.
- Apache Spark
- Databricks
- Databricks Runtime
- Delta Lake
- iceberg
- Jordan Soldo
- Nikhil Tallam
- OpenSharing
- Unity Catalog
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →