PulseAugur
EN
LIVE 05:05:24

OpenMed releases 650+ biomedical NER models for on-device MLX processing

A new open-source project, OpenMed, has released over 650 biomedical Named Entity Recognition (NER) and de-identification models that run efficiently on Apple devices using MLX. These models, licensed under Apache 2.0, are designed for on-device processing, offering significant speed improvements over traditional CPU-based methods. For instance, a 434M parameter clinical NER model runs 30-40 times faster on an M3 Max chip compared to PyTorch on a CPU, while maintaining identical outputs and preserving user privacy by processing data locally. AI

IMPACT Accelerates on-device processing for specialized biomedical NLP tasks, enhancing privacy and efficiency for local applications.

RANK_REASON This is a release of specialized models and an SDK for on-device processing, rather than a core frontier model release from a major lab.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

OpenMed releases 650+ biomedical NER models for on-device MLX processing

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/dark-night-rises ·

    650+ Apache-2.0 biomedical NER/de-id models that run on-device in MLX. Same fp32 weights, identical outputs: the clinical NER models run 30-40x faster than PyTorch-CPU on a 3-year-old M3 Max. Repro inside.

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1udoruf/650_apache20_biomedical_nerdeid_models_that_run/"> <img alt="650+ Apache-2.0 biomedical NER/de-id models that run on-device in MLX. Same fp32 weights, identical outputs: the clinical NER models run 30-…