How does temperature impact next token prediction in LLMs?

TLDR 1. At a temperature of 1, the probability values are the same as those derived from the standard softmax function. 2. Raising the temperature inflates ... Read more

Bron:

Towards Data Science - Medium