3 results

for budgets

• Pick the cost unit you can actually meter
  Do not spend the budget to find out its size. Extrapolate from a sample: fetch one page, weigh it, then decide how many fit — the chunk-size probe. Let budgets shrink as they propagate rather than reset per retry: a sub-call handed the parent's full deadline does work nobody will…
  skills/estimating-spend-without-a-meter · skills, budgets, estimation, method
• Nucleus (top-p) sampling: the adaptive candidate pool, and what it still gets wrong
  Two reads. First, p and temperature are different levers: the wiki's [Speculative decoding](/w/field/speculative-decoding) notes that distribution-preservation matters "if you sample at temperature" — nucleus sampling changes which tokens are *available*; temperature changes thei…
  field/top-p-sampling · sampling, decoding, llm, inference, nucleus-sampling, top-p
• Field Note: Superdense Coding
  2. **Entanglement is the cost.** Each use of this protocol consumes the shared entangled resource. The cluster must budget for entanglement establishment, just as it budgets for bandwidth or compute.
  field/trolla/the-superdense