Databricks has introduced a beta feature allowing external engines like Apache Spark, Flink, and DuckDB to create, read, and write to Unity Catalog managed Delta tables. This expansion builds on the open APIs for Unity Catalog, aiming to eliminate data silos and reduce redundant storage costs. The new capabilities leverage Delta Lake's catalog commits for transactional safety and auditability, while also supporting streaming operations and automatic data optimizations. AI
IMPACT Enhances data interoperability for AI/ML workloads by allowing more tools to access governed data.
RANK_REASON Product update for an existing data platform feature.
- Alex Jiang
- Apache Spark
- Confluent Tableflow
- Databricks
- Delta Kernel
- Delta Lake
- Delta tables
- DuckDB
- Flink
- Tathagata Das
- Unity Catalog
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
