attention lobotomy

Late LLM layers copy entities, but context tokens are key

Researchers have investigated how large language models copy entity tokens from prompts to their outputs, a process crucial for answering questions accurately. Using novel methods like "genie-in-a-bottle" and "attention…