Sinusoidals, Rotary Positionals, and YaRN

Published on: 4-27-2025

A sweet visualization of the different variations of embeddings found in modern LLMs