Litert
PulseAugur coverage of Litert — every cluster mentioning Litert across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Google launches LiteRT.js for in-browser AI model inference
Google has introduced LiteRT.js, a JavaScript binding for its on-device inference library, formerly known as TensorFlow Lite. This new tool allows .tflite models to run directly within web browsers, leveraging WebGPU, W…
-
PrintGuard 2.0 launches with 5MB TFLite model for browser and CPython
PrintGuard 2.0 is an updated system for detecting failures in 3D printing, utilizing a ShuffleNetV2 encoder and a prototypical network for few-shot fault detection. The new version features a significantly smaller Tenso…
-
Linux GUI released for LiteRT local LLM tool
A user on the r/LocalLLaMA subreddit has shared a graphical user interface (GUI) for LiteRT, a tool for running large language models locally. The GUI is designed for Ubuntu and Debian Linux distributions and is availab…
-
Developer builds tiny offline AI for Morse code recognition on Android
A developer has created an Android feature that recognizes Morse code from images and live camera feeds using a small, on-device AI module. This module, weighing under 5 MB, operates entirely offline and utilizes LiteRT…
-
Local Gemma models achieve 2.5x speedup with LiteRT endpoint
A user has successfully integrated Google's Gemma 2B and 4B models into a local setup, achieving significantly faster performance than API-based models. This was accomplished by wrapping the LiteRT engine, designed for …
-
LiteRT boosts edge LLM speed by trading compute for bandwidth
Researchers have developed a new method called LiteRT to improve the performance of edge LLMs, which are often constrained by memory bandwidth. By trading compute for bandwidth, LiteRT enables these models to achieve sp…