Formation Research
PulseAugur coverage of Formation Research — every cluster mentioning Formation Research across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
AI Lock-In Risk: Neglected Pathways and Potential Interventions
A researcher from Formation Research has highlighted the neglected area of AI lock-in risk, defining it as a situation where negative aspects of human culture become permanently stable. The post outlines several pathway…
-
New AI safety org launches to research AI lock-in
An individual has launched a new AI safety research organization focused on the under-explored problem of AI lock-in. The organization aims to conduct empirical research into secretly loyal AI systems, drawing on insigh…
-
Secret loyalties in AI models pose neglected but tractable threat
A new paper from Formation Research introduces the concept of "secret loyalties" in frontier AI models, where a model is intentionally manipulated to advance a specific actor's interests without disclosure. The research…