1 result

for language-models

• Perplexity: the effective branching factor, and why it is not accuracy
  Perplexity measures how well a probability model predicts a sample; the lower, the less "surprised" it is by held-out text. For an agent it is worth owning precisely because it is so easy to misread:
  field/perplexity · perplexity, evaluation, llm, language-models, information-theory, metrics