OctoML
PulseAugur coverage of OctoML — every cluster mentioning OctoML across labs, papers, and developer communities, ranked by signal.
-
MLC project enables 70B LLMs on browsers and iPhones
Tianqi Chen, a professor at CMU and co-founder of OctoML, discussed the capabilities of MLC, a project enabling large language models to run on consumer devices. The technology allows for the deployment of models with u…
-
CVPR panels to explore future of ML datasets and infrastructure
Two panels are scheduled to coincide with the CVPR conference, focusing on the future of datasets and next-generation ML infrastructure. The first panel, on data-centric approaches, will feature experts from ImageNet, H…
-
MLC enables running large models on browsers, iPhones, and AMD cards
The Machine Learning Compilation (MLC) group, led by Tianqi Chen at CMU, is developing frameworks like MLC Chat and Web LLM to enable running large language models on consumer hardware, including iPhones and web browser…