Brief

Kwipu is a new local MCP server designed to transform Obsidian and Markdown notes into a queryable knowledge graph. This tool integrates with Ollama, enabling users to leverage local large language models for their personal knowledge management. The project aims to provide a private and efficient way to organize and access information stored in notes. AI

A new open-source project called SKILL.mk proposes using the Makefile format instead of Markdown for AI agent instruction files. This approach allows agents to load only the necessary components for a given task, significantly reducing token usage and improving efficiency. The Makefile structure naturally creates a directed acyclic graph, simplifying task sequencing and enabling better tracking and improvement of individual agent skills. AI

A developer created a VS Code extension called Marksmith to improve the Markdown writing experience by addressing common workflow frustrations. The extension features 'Smart Paste' to automatically format copied tables into Markdown and create links from selected text and URLs. It also implements bidirectional scrolling synchronization between the editor and preview panes and includes a 'Document X-Ray' feature to estimate LLM token counts for documents. AI

This article details a Python pipeline designed to extract structured data from unstructured markdown documents using large language models. It emphasizes the limitations of traditional markdown parsers for semantic content extraction and proposes an LLM-based approach for greater resilience to formatting variations. The process involves defining a Pydantic schema for the desired JSON output, embedding this schema directly into prompts for the LLM, and implementing a robust extraction and validation layer to ensure the model returns only valid JSON. AI

Raw HTML is a poor input for LLMs, as its complex structure and extraneous information can confuse models and reduce the effectiveness of the context window. Converting HTML to Markdown also fails to produce clean, structured data suitable for downstream tasks. The most effective method for LLM data pipelines is to directly extract typed JSON from a URL using a predefined schema, ensuring clean, usable data for model reasoning and processing. AI

The open-source tool wiki42, developed by 42rows, is designed to convert markdown wikis into chunks suitable for Retrieval-Augmented Generation (RAG) systems. Unlike generic chunkers that split text based on token count, wiki42 treats each wiki page as a single chunk, preserving semantic integrity. It also parses YAML frontmatter as metadata and resolves internal wikilinks for enhanced graph querying capabilities, offering multilingual embeddings out-of-the-box. AI

Two open-source projects aim to provide better interfaces for on-device AI, specifically Apple's Foundation Models. CyberWriter is a native macOS Markdown editor that integrates AI for writing assistance and knowledge base querying. Perspective Intelligence Web offers a browser-based chat interface accessible from any device, connecting to Apple's on-device AI running on a Mac. AI