Researchers have developed a local Large Language Model (LLM) approach to classify sensitive information in government documents, specifically focusing on the deliberative process privilege for Freedom of Information Act (FOIA) requests. The study utilized the Qwen3.5 9B model, which can run on consumer-grade hardware, to avoid legal and political issues associated with cloud-based APIs. Their method, combining Chain-of-Thought and few-shot prompting with error-based examples, achieved performance comparable to commercial models and improved upon previous work in recall and F2 scores. Analysis revealed that sentences classified as deliberative often contain verbs indicating opinion and are phrased in the first person. AI
IMPACT Enables secure, on-premise classification of sensitive government documents, potentially improving compliance with transparency laws.
RANK_REASON Academic paper detailing a novel methodology for document classification using LLMs. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
