Using group theory to explore the space of positional encodings for attention

This post extends the positional encoding exploration for attention models capability by exploring novel methods for sequence weighting, potentially leading to more efficient and accurate models.