WikiMIA

New Gap-K% method detects LLM pretraining data

Researchers have developed a new method called Gap-K% to detect pretraining data used in large language models. This technique analyzes the gap between a model's top prediction and the actual target token, leveraging th…