The AI That Writes One Character at a Time
Contents › Chapter 2 How it learned
Human writing is the textbook
One sentence from a fairy tale becomes many practice quizzes
View in 3DHuman writing is the textbook
This AI's textbook is fairy tales written by people. The row at the top is one sentence from a story. Every character becomes a quiz: "Look at the characters before, and guess this one." Each tile's color is the percent the AI gave the correct answer. Red is 0%, green is 100%. Use the button on screen to compare before learning with after.
Why?The correct answers are already written in the sentence, so no one has to grade them by hand. 40 stories, about 380,000 characters, give about 380,000 quizzes like this.
Learn moreMaking quizzes and answers from the text itself, without people labeling the answers, is called self-supervised learning. Chatbots also learn this way first, from a huge amount of text.
View this scene in 3D →More in the series
A small AI (a character-level language model with 62,652 dials) was really trained on 40 fairy tales and fables retold for this project (about 376,021 characters), and every number here was calculated by that AI. It is a tiny model for learning; real chatbots are far bigger.