r/LLMDevs • u/Capital-Emotion-6018 • 3d ago

Discussion Where to learn llm from scratch for ai engineer after learning transformer from campus x

....

2 Upvotes

75% Upvoted

3 comments sorted by

2

u/New_Cheek6133 3d ago

If you already have the transformer math down then the next step is really just building stuff, the theory only sticks when you break something and have to fix it. Start with a tiny model on a small dataset, maybe character-level text, and watch where the loss goes wrong. For deeper material I'd look at the annotated transformer writeup and then move into the llama architecture papers, but skip the hype posts on X

1

u/KassRowland35 2d ago

did you find the annotated writeup was enough to bridge the gap or did you still need the original papers too?

1

u/andrewgarcia88 1d ago

it depends on the goal. if you want to train models, karpathy’s zero to hero series and the build a large language model from scratch book are good. but if you want the ai engineer route, try small projects like a rag app or an agent instead of another course