New week, new slides: Run LLMs Locally I added virtualization of OpenCode with Matchlock and Firecracker microVMs, containerization of OpenCode and llama.cpp wi
Thomas Bley has updated his presentation on running large language models locally. The new slides include virtualization of OpenCode using Matchlock and Firecracker microVMs, as well as containerization of OpenCode and llama.cpp with Docker. Additionally, a new section addresses indirect prompt injection attacks. AI
IMPACT Enhances local LLM deployment with new virtualization and containerization techniques, while also addressing security vulnerabilities.