Dec 9, 2024
great read. written on a similar topic here: https://theshresthshukla.medium.com/what-is-scaling-in-transformers-self-attention-you-ll-not-regret-reading-this-d37121f6644e
Written by Shresth Shukla
Data & AI @ EY, Freelance Technical Writer (AI/ML/GenAI Domain) MTech @BITS Pilani Maths Hons @DU