I understand that the transformer architecture may seem scary, and you might have encountered various explanations on YouTube or in blogs. However, in my blog, I will make an effort to clarify it by providing a comprehensive numerical example. By doing so, I hope to simplify the understanding of the transformer architecture.
Shoutout to HeduAI for providing clear explanations that have helped clarify my own concepts!
Let’s get Started!
Inputs and Positional Encoding
Let’s solve the initial part where we will determine our inputs and calculate positional encoding for them.