iceberg
PulseAugur coverage of iceberg — every cluster mentioning iceberg across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
Databricks OpenSharing replaces data copying with live table reads
Databricks has introduced OpenSharing, a new protocol designed to replace traditional file and API data feeds. This system allows recipients to read shared data directly from the provider's storage in real-time, elimina…
-
Databricks details OpenSharing, Clean Rooms, and Marketplace for data asset collaboration
Databricks offers three distinct tools for data and AI asset sharing: OpenSharing, Clean Rooms, and Marketplace. OpenSharing provides live, read-only access to data assets for known recipients, even those not on Databri…
-
Databricks AI Search adds live intelligence support for Streaming Tables and Iceberg
Databricks has enhanced its AI Search capabilities to support live intelligence features. This update allows Databricks AI Search to work with Streaming Tables, Materialized Views, and Managed tables that utilize the Ic…
-
Databricks enhances AI Search with live intelligence features and offers free educational platform
Databricks is enhancing its AI Search capabilities by integrating support for Streaming Tables, Materialized Views, and Managed tables within the Iceberg format. This advancement allows for the creation of live intellig…
-
Databricks AI Search adds native support for Streaming Tables, Iceberg
Databricks has enhanced its AI Search functionality to natively support three new data sources: Streaming Tables, Materialized Views, and Managed tables using Iceberg v3+. This integration allows users to directly incor…
-
End-to-End Data Lineage with Spark, Iceberg, and Open Source Tools
This article discusses end-to-end data lineage using Apache Spark and Iceberg, integrating tools like OpenLineage, OpenMetadata, and Marquez. It aims to provide transparency into data pipelines by tracking the journey o…
-
Databricks Unity Catalog emphasizes user control over data storage
Databricks has detailed its strategy for managing data storage in Unity Catalog, emphasizing user control and open formats. The platform allows users to store managed table data in their own cloud storage accounts, such…
-
LLMs struggle with data accuracy, achieving below 21% on enterprise workloads
Connecting large language models like Claude and GPT-4 to data sources yields surprisingly low accuracy, often below 21% on complex enterprise workloads. This is because models struggle with ambiguous field definitions …
-
Organizing Data Layers: From Data Catalog to AI Platform
This article explores the organization of data management technologies, including Data Lakes, Lakehouses, Iceberg, and RDBMS, into distinct layers. It aims to provide a framework for understanding these components, movi…
-
Databricks makes Variant data type generally available for faster data ingestion
Databricks has announced the general availability of its Variant data type, designed to improve the ingestion and querying of semi-structured data. This feature, along with Variant Shredding, uses predictive optimizatio…
-
Data Versioning Tools for ML and Data Lakes Reviewed
This article provides a practical overview of data versioning tools for machine learning and data lakes. It examines platforms such as Dolt, DVC, Delta Lake, Iceberg, Hudi, and lakeFS, offering insights into their capab…
-
GitLake introduces Git-for-data for agentic lakehouses
Researchers have introduced GitLake, a novel system designed to function as a Git-for-data solution for agent-first lakehouses. This system enables lakehouse-wide commits, branches, and merges by elevating single-table …
-
Databricks aims to bridge AI agent-business gap with new LTAP infrastructure
Databricks is focusing on bridging the gap between AI agents and business understanding, as highlighted at their Data + AI Summit 2026. A key announcement was Lake Transactional/Analytical Processing (LTAP), an infrastr…
-
AWS event-driven data pipelines leverage Lambda, dlt, and Iceberg
This article details an event-driven data pipeline architecture built on AWS, designed to overcome the limitations of traditional cron-job-based pipelines. The proposed solution uses AWS Lambda, dlt, and Iceberg to auto…
-
Text-to-SQL LLM risks: Data leaks and cost overruns
The notion that Text-to-SQL is a solved problem is a dangerous myth, as LLMs can generate non-deterministic SQL queries that pose risks to sensitive data. Approaches like feeding the entire schema to the LLM or using se…
-
Cranium AI acquires Aiceberg to boost autonomous AI agent governance
Cranium AI has acquired Aiceberg, a company specializing in autonomous AI agents. This acquisition is aimed at enhancing Cranium AI's capabilities in agentic AI governance. The move is expected to bolster Cranium AI's o…
-
dbt and SQLMesh co-exist on self-hosted lakehouse via Nessie REST
A technical comparison details the challenges and solutions encountered when running dbt and SQLMesh simultaneously on a self-hosted lakehouse environment. The author outlines a specific stack including PostgreSQL, Seaw…
-
Databricks Catalog Commits GA unifies lakehouse data coordination
Databricks has announced the general availability of Catalog Commits for Unity Catalog managed tables, a significant platform upgrade. This feature aims to unify the lakehouse by aligning Delta Lake with Iceberg's catal…
-
Spice.ai launches 1.0-stable engine for SQL data querying and AI inference
Spice.ai has released version 1.0-stable, an open-source engine designed to simplify the creation of data-driven AI applications and agents. The engine allows developers to query, federate, and accelerate data from vari…