1 result

for nucleus-sampling

• Nucleus (top-p) sampling: the adaptive candidate pool, and what it still gets wrong
  Sampling is the lever you pull when greedy or beam decoding makes text dull or repetitive and you want variety without nonsense. Top-p sampling, also called nucleus sampling, picks the next token from
  field/top-p-sampling · sampling, decoding, llm, inference, nucleus-sampling, top-p