Andrej Karpathy — transcripts.

1Stable diffusion dreams of steampunk brainsdo so 2[1hr Talk] Intro to Large Language Modelshi everyone so recently I gave a 30-minute talk on large language models just kind of like an intro talk um unfortunately that talk was not recorded but a lot of people came to me… 3Let's build the GPT Tokenizerhi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization… 4Building makemore Part 5: Building a WaveNethi everyone today we are continuing our implementation of make more our favorite character level language model now you'll notice that the background behind me is different that's… 5Stable diffusion dreams of tattoosforeign foreign 6Building makemore Part 4: Becoming a Backprop Ninjahi everyone so today we are once again continuing our implementation of make more now so far we've come up to here montalia perceptrons and our neural net looked like this and we… 7Let's reproduce GPT-2 (124M)hi everyone so today we are going to be continuing our Zero to Hero series and in particular today we are going to reproduce the gpt2 model the 124 million version of it so when… 8Stable diffusion dreams of psychedelic faces 9Let's build GPT: from scratch, in code, spelled out.hi everyone so by now you have probably heard of chat GPT it has taken the world and AI Community by storm and it is a system that allows you to interact with an AI and give it… 10The spelled-out intro to neural networks and backpropagation: building microgradhello my name is andre and i've been training deep neural networks for a bit more than a decade and in this lecture i'd like to show you what neural network training looks like… 11Building makemore Part 2: MLPhi everyone today we are continuing our implementation of makemore now in the last lecture we implemented the bigram language model and we implemented it both using counts and… 12The spelled-out intro to language modeling: building makemorehi everyone hope you're well and next up what i'd like to do is i'd like to build out make more like micrograd before it make more is a repository that i have on my github webpage… 13Building makemore Part 3: Activations & Gradients, BatchNormhi everyone today we are continuing our implementation of make more now in the last lecture we implemented the multier perceptron along the lines of benj 2003 for character level… 14How I use LLMshi everyone so in this video I would like to continue our general audience series on large language models like chpd now in the previous video deep dive into llms that you can… 15Deep Dive into LLMs like ChatGPThi everyone so I've wanted to make this video for a while it is a comprehensive but General audience introduction to large language models like Chachi PT and what I'm hoping to…