The AI That Writes One Character at a Time
Contents › Chapter 5 A look inside
Summary: four steps
Number tag, board, clues, then scores and percents
View in 3DFour steps to guess one character
Fourth, it uses the clues it gathered to give every character a score. The higher the score, the bigger the percent. These percents are the slot widths on the reel you saw at the start. The box below sums up all four steps.
Why?This calculation is a huge number of multiplications and additions. Even this small AI multiplies and adds hundreds of thousands of times to guess one character. Work that would take a person weeks by hand, a computer finishes in the blink of an eye.
Learn moreTurning scores into percents that add up to 100% is called softmax. Gathering clues and calculating is done twice (2 layers).
View this scene in 3D →Read more
More in the series
A small AI (a character-level language model with 62,652 dials) was really trained on 40 fairy tales and fables retold for this project (about 376,021 characters), and every number here was calculated by that AI. It is a tiny model for learning; real chatbots are far bigger.