absolute positional embedding

Absolute positional embedding, as opposed to relative positional embedding, is directly associated with specific positions of a token in a sequence. For each position in the input sequence, a unique embedding is added to the token’s embedding to get information on its exact location.