Simple pseudocode for transformer decoding a la GPT

Oct 12, 2023 ·

A number of people have asked me for this, so I’m posting it here: Bob Carpenter. 2023. Transformer decoding in fifty lines of pseudocode. This is a short note that provides complete and relatively simple pseudocode for the neural network … Continue reading →