New technique reveals open-weight LLMs can memorize entire copyrighted books

A new study on arXiv details a method for extracting memorized book content from open-weight language models. Researchers found that while most models do not extensively memorize most books, there are significant exceptions, with Llama 3.1 70B fully memorizing some titles like 'Harry Potter and the Sorcerer's Stone'. This extensive memorization allows for deterministic extraction of entire books using minimal prompts, impacting ongoing copyright disputes. AI

IMPACT Findings could influence copyright litigation and model training practices regarding memorization of copyrighted material.

RANK_REASON Academic paper detailing a new method for extracting memorized content from LLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• arXiv
• Harry Potter and the Sorcerer's Stone
• Llama 3.1 70B

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →