model : add support for talkie-1930-13b by niklassheth · Pull Request #22596 · ggml-org/llama.cpp
A new language model, talkie-1930-13b-it, has been developed, trained exclusively on English text from before 1931. This 13 billion parameter model is an instruction-tuned version of talkie-1930-13b-base, which was initially trained on 260 billion tokens. The fine-tuning process utilized a unique dataset of instruction-response pairs derived from historical reference works, followed by reinforcement learning to enhance its ability to follow instructions. AI
IMPACT This model offers a novel approach to historical language simulation, potentially enabling new research into past communication styles and knowledge.