Delta Lake
PulseAugur coverage of Delta Lake — every cluster mentioning Delta Lake across labs, papers, and developer communities, ranked by signal.
5 day(s) with sentiment data
-
Azure Databricks Enhances MLOps with Apache Spark and Delta Lake
This article discusses the use of Azure Databricks for MLOps and feature engineering at scale. It highlights how the platform leverages Apache Spark and Delta Lake to handle large datasets for effective feature creation…
-
Data Lakes vs. Cloud Data Warehouses: Choosing the Right Architecture
This guide compares data lake and cloud data warehouse architectures, highlighting their differences in data storage, query performance, governance, and cost. Data lakes excel at storing raw, multi-format data for machi…
-
Databricks outlines unified data pipeline architecture with Lakeflow
Databricks has detailed its approach to data pipeline architecture, emphasizing a unified platform that integrates batch and streaming data processing. The company highlights that effective architecture separates data i…
-
Databricks launches OpenSharing for AI agents, models, and data
Databricks has introduced OpenSharing, an evolution of its Delta Sharing protocol designed for the agentic AI era. This new open-source protocol, now hosted by the Linux Foundation, expands beyond data sharing to encomp…
-
Text-to-SQL LLM risks: Data leaks and cost overruns
The notion that Text-to-SQL is a solved problem is a dangerous myth, as LLMs can generate non-deterministic SQL queries that pose risks to sensitive data. Approaches like feeding the entire schema to the LLM or using se…
-
Databricks enables unified data access control across engines
Databricks has introduced a beta version of its Cross-Engine ABAC feature, allowing attribute-based access controls to be defined once in Unity Catalog and enforced across various external data engines. This new capabil…
-
AI workloads demand new data architecture layer
The traditional data stack is insufficient for modern AI workloads, which require handling unstructured data, real-time embeddings, and robust lineage tracking. A new 'Platinum' or AI-native layer is proposed, extending…
-
Databricks launches analytics engineer learning pathway for SQL pros
Databricks has launched a new learning pathway designed for SQL practitioners to become analytics engineers. This curriculum focuses on transforming raw data into governed, AI-ready semantic models and metric views with…
-
Databricks launches AI sales tool for prescriptive actions
Databricks has developed PipelineIQ, an AI-powered sales intelligence tool designed to move beyond traditional forecasting. Instead of relying on retrospective data, PipelineIQ analyzes messy CRM information to provide …
-
Databricks enables external engines to write to Unity Catalog tables
Databricks has introduced a beta feature allowing external engines like Apache Spark, Flink, and DuckDB to create, read, and write to Unity Catalog managed Delta tables. This expansion builds on the open APIs for Unity …
-
Unified Revenue Platform architecture tackles sales analytics fragmentation
This article proposes a four-layer architecture for a Unified Revenue Platform (URP) to address the fragmentation of sales analytics in B2B organizations. The proposed system integrates CRM data ingestion, target cascad…
-
Databricks MCP lets AI agents directly query Lakehouse data
Databricks has released an integration called MCP that allows AI agents like Claude and Cursor to directly access and interact with data stored in Databricks Lakehouse. This tool enables AI models to query Delta tables,…
-
Databricks Catalog Commits GA unifies lakehouse data coordination
Databricks has announced the general availability of Catalog Commits for Unity Catalog managed tables, a significant platform upgrade. This feature aims to unify the lakehouse by aligning Delta Lake with Iceberg's catal…
-
SAP acquires Dremio and Prior Labs to bolster its AI-ready data platform
SAP has acquired Dremio, a data lakehouse provider, to enhance its data analytics and AI capabilities. This move aims to unify enterprise data, both internal and external, to power AI agents at scale. The acquisition em…
-
Databricks syncs operational Postgres data to Lakehouse natively
Databricks has introduced Native Lakehouse Sync, a feature that allows operational PostgreSQL data from its Lakebase to be automatically replicated into Unity Catalog managed tables. This eliminates the need for traditi…
-
Databricks and Google Cloud enable data interoperability via catalog federation
Databricks and Google Cloud have enhanced interoperability between their data platforms, Unity Catalog and BigQuery, respectively. This new integration allows customers to access the same data from either platform witho…