Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

by leromanon 2/5/2025, 6:29 PMwith 46 comments

by vimgrinderon 2/6/2025, 2:32 AM

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos:

1. minGPT, nanoGPT (transformers)

2. NLP (make more series)

3. tokenizers (his youtube)

4. RNN (from his blog)

There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on ML.

by levocardiaon 2/6/2025, 12:19 AM

I tell all my friends that Andrej was the best instructor I had in grad school, even though I didn't even go to Stanford--I just watched his CS321n videos on YouTube. Really thrilled that he's still making videos.

by ipsum2on 2/5/2025, 6:53 PM

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

by sota_popon 2/5/2025, 7:15 PM

Really love his “let’s build” series - I end up picking up cool Python tricks along the process, even in addition to the higher level content.

by bicepjaion 2/6/2025, 2:13 AM

I still remember how to back propagate using python lists which was part of CS231n project by @karpathy. Amazing thing is I did not goto Stanford.

by Dinuxon 2/5/2025, 9:21 PM

Thanks Andrej. I have a pretty good understanding of how LLMs work and how they are trained, but alot of my friends don't. These videos/talks give them 'some' idea.

by arvinsimon 2/6/2025, 8:52 AM

It frustrates me that I can't focus on these long-form videos when they are likely much better than the soundbite sized video counterparts.

by brianjkingon 2/7/2025, 3:06 PM

Karpathy is too good to us. These videos are so incredibly valuable, thank you for sharing.

by stuckkeyson 2/5/2025, 11:05 PM

I sat through the entire thing...my cheeks fell asleep but well Worth it. Thak you Andrej!

by behnamohon 2/5/2025, 10:06 PM

I'm a simple man, I see a Karpathy video, I click, I watch, I enjoy. :)

by demarqon 2/5/2025, 7:25 PM

I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons.

I think this is important content, the more people know how ai works under the hood the more empowered society will be.

by tmp111111on 2/5/2025, 8:02 PM

Andrej, I like you much more now than when you were at Tesla. You have been adding real value to my life and many others. Thank you.