PulseAugur
EN
LIVE 21:28:55

New algorithm reconstructs PII from finetuned language models

Researchers have developed a new decoding algorithm called COVA to reconstruct personally identifiable information (PII) from supervised finetuned language models. The study focused on sensitive domains like medical and legal settings, demonstrating that an adversary with even partial knowledge of the fine-tuning dataset can infer sensitive user data. The effectiveness of PII reconstruction varied by PII type, highlighting significant privacy risks associated with current fine-tuning practices. AI

IMPACT Reveals significant privacy risks in LLM fine-tuning, potentially impacting data handling and model deployment strategies.

RANK_REASON Academic paper detailing a new method for reconstructing PII from finetuned language models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New algorithm reconstructs PII from finetuned language models

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Alina Oprea ·

    Reconstruction of Personally Identifiable Information from Supervised Finetuned Models

    Supervised Finetuning (SFT) has become one of the primary methods for adapting a large language model (LLM) with extensive pre-trained knowledge to domain-specific, instruction-following tasks. SFT datasets, composed of instruction-response pairs, often include user-provided info…