由卡内基梅隆大学（CMU）的 Tianqi Chen 领导的机器学习编译（MLC）小组正在开发 MLC Chat 和 Web LLM 等框架，以支持在包括 iPhone 和网页浏览器在内的消费级硬件上运行大型语言模型。该计划旨在通过允许模型在配备 AMD 显卡甚至仅 CPU 的设备上本地运行，来缓解当前的 GPU 短缺问题。Hugging Face 的 text-to-webapp 生成器和 Gradio 等项目也在为开发者和最终用户更轻松地部署和访问机器学习模型做出贡献。 AI
排序理由 该集群讨论的是用于更广泛可访问性的机器学习编译框架和工具的研究与开发，而非特定的前沿模型发布或重大的行业转变。
AI 生成摘要 · Google Gemini · 来自 8 个来源。 我们如何撰写摘要 →
ML systems, production & scaling, execution & collaboration, building for users, conference etiquette.
Daliana and I had a 2hr chat on all things data science and machine learning.
Design and architecture, tech stack, methodology, results, and lessons learned.
<p><em>We have just announced our first set of speakers at </em><a href="https://www.ai.engineer/summit" target="_blank"><em>AI Engineer Summit</em></a><em>! Sign up for the livestream or email </em><a href="http://[email protected]" target="_blank"><em>[email protected]</e…
<p>Abubakar Abid joins Daniel and Chris for a tour of <a href="https://www.gradio.app">Gradio</a> and tells them about the project joining Hugging Face. What’s Gradio? The fastest way to demo your machine learning model with a friendly web interface, allowing non-technical users …
<p>Tuhin Srivastava tells Daniel and Chris why <a href="https://www.baseten.co">BaseTen</a> is <em>the</em> application development toolkit for data scientists. BaseTen’s goal is to make it simple to serve machine learning models, write custom business logic around them, and expo…
<p>MLCommons launched in December 2020 as an open engineering consortium that seeks to accelerate machine learning innovation and broaden access to this critical technology for the public good. David Kanter, the executive director of MLCommons, joins us to discuss the launch and …