Hello, I'm Ganesh. I'm building git-lrc , an AI code reviewer that runs on every commit. It is free, unlimited, and source-available on Github. Star Us to help devs discover the project. Do give it a try and share your feedback for improving the product.

In a previous article, I explained about the embedding and preprocessing of input.

In this article we will discuss step 2 of the transformer model, i.e. position encoding.

What is Positional Encoding?

Positional encoding is a technique used to encode the position of a word in a sentence. It is used to overcome the limitation of the transformer model that it cannot process the input in parallel.

Basically whenever the input text is given to the transformer model.

say

The Lion attacked Deer.…