Databricks has introduced Funke, an open-source accelerator designed to parse HL7v2 electronic health record messages directly into native Spark types on the Databricks Lakehouse. This new Python and PySpark library is the successor to their 2021 Scala library, Smolder, and integrates with modern Databricks features like Unity Catalog and Spark Declarative Pipelines. Funke aims to provide a lossless parsing process, preserving the full hierarchy of HL7v2 messages without requiring conversion to FHIR or using third-party flattening tools, thereby reducing cost and latency for healthcare data analytics. AI
IMPACT Enhances healthcare data processing by enabling direct, lossless parsing of HL7v2 messages within the Databricks Lakehouse.
RANK_REASON Databricks released a new open-source tool for data parsing.
- Andy Launchbury
- Apache Spark
- Chris Mantz
- Databricks
- Declarative Automation Bundles
- Fast Healthcare Interoperability Resources
- Funke
- HL7v2
- PySpark
- Python
- Sean Fischer
- Spark Declarative Pipelines
- Unity Catalog
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →