Talkie AI: Vintage language model trained on pre-1931 data aims to reveal AI's inner workings

A team of AI researchers has developed Talkie, a 13-billion-parameter language model trained exclusively on English-language texts published before the end of 1930. The creators aim to use Talkie to better understand AI behavior and capabilities by studying its responses and predictive abilities within a historical knowledge constraint. While Talkie can generate some simple code solutions, its programming capabilities are limited compared to models trained on modern data. AI

IMPACT Offers a novel approach to studying AI behavior and predictive capabilities by isolating historical knowledge.

RANK_REASON Release of a large language model trained on historical data for research purposes.

Read on The Register — AI →

• Amelia Earhart
• Bertrand Russell
• Betty Boop
• David Duvenaud
• Demis Hassabis
• Einstein
• Franklin D. Roosevelt
• Google DeepMind
• University of Toronto
• xAI

• model release
• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →