Geoffrey Irving
PulseAugur coverage of Geoffrey Irving — every cluster mentioning Geoffrey Irving across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
Sam Altman: Society must accept AI harms for benefits, sparking debate
OpenAI CEO Sam Altman stated that society must accept certain "bad things" like hacks and scams resulting from AI development in exchange for the technology's immense benefits and wider accessibility. He contrasted this…
-
AI researchers warn of existential risk from superintelligence · 1 source tracked
Several AI researchers from leading companies like OpenAI, Google DeepMind, and Anthropic have expressed grave concerns about the existential risks posed by superintelligent AI. In interviews collected by Palisade Resea…
-
AI Safety Nonprofits Seek Founders with $200M+ Grants via Project Tailwind
Max Nadeau, part of Coefficient Giving's Technical AI Safety team, is spearheading Project Tailwind, an initiative designed to foster a new wave of AI safety nonprofits. This project aims to provide significant funding,…
-
Resolution aims to establish AI alignment as a global academic discipline
Resolution, a new organization focused on Artificial Superintelligence (ASI) alignment, is being praised for its strategic decisions and multidisciplinary approach. Led by Geoffrey Irving, the group aims to establish AI…
-
AI alignment experts: Fundamental mistakes are unfixable
Geoffrey Irving and Tom Reed argue that fundamental alignment mistakes in AI systems are inherently unfixable. They propose that once an AI's core objectives are misaligned, it becomes impossible to correct these object…
-
AI alignment expert: Superintelligence could arrive in 2-3 years, current plans may fail
Geoffrey Irving, a former researcher at OpenAI and Google DeepMind, predicts that superintelligence could emerge within two to three years. He believes current AI alignment strategies, such as training models for good c…
-
AI Safety Org Resolution Raises $160M, Anthropic AI Involved in Hacking
Resolution, a new AI safety organization, has raised $160 million from Coefficient Giving and merged with Timaeus. The organization focuses on combining automated alignment research with deep theoretical understanding a…
-
AI safety funding could mimic VC for higher returns · 1 source tracked
The article proposes adopting principles from venture capital funding into the nonprofit sector, particularly for AI safety initiatives. It argues that early donations to promising projects, like the AI safety research …
-
AI leaders debate coordinated development slowdown post-Hugging Face incident
The AI community is discussing the implications of the Hugging Face incident, with a focus on the potential for a coordinated slowdown in AI development. OpenAI researcher Roon expressed concern about unilateral slowdow…
-
New nonprofit Sequent launches to boost AI alignment confidence
A new nonprofit research organization called Sequent has been launched with the goal of improving AI alignment confidence. The organization plans to invest heavily in automation and theoretical research to accelerate pr…
-
New mechanistic estimation method outperforms sampling for wide random MLPs
Researchers have developed a new method for estimating the expected output of wide, randomly initialized multilayer perceptrons (MLPs) without needing to run samples through the model. This "mechanistic estimation" appr…