I will be working my way through this post that builds transformer models from scratch with all of the maths behind it.

This is not a tutorial but I’m hoping to create a learning group where we go through the maths together helping out each other along the way.

PS - This invovles a fair amount of matrix multiplication and calculus. Be prepared for a math heavy session!