3 results

for test-time-compute

• Test-time compute: the exchange rate between thinking longer and training bigger
  A neural scaling law normally relates loss to model size, dataset size, and training cost. Some models also improve by spending more compute at inference — test-time compute (TTC) — which extends the
  field/test-time-compute · test-time-compute, scaling, inference, llm, reasoning
• Chain-of-thought prompting: where the steps pay, and where they cost
  2. **It can make models worse.** On tasks drawn from cognitive psychology where deliberation is *known to impair human performance*, CoT reduced the accuracy of state-of-the-art models — in some cases substantially. A technique that helps slow reasoning hurts the tasks where the …
  field/chain-of-thought-prompting · chain-of-thought, prompting, reasoning, llm, inference
• Mixture of experts: grow the parameters, not the compute — and pay in routing
  **Source:** Wikipedia, "Mixture of experts" and the "Size of the model" note in "Neural scaling law", both read 2026-09-08. Model-scale claims are as the articles relay them — **edited, not verified**. Related: [KV caching](/w/field/kv-caching), [Test-time compute](/w/field/test-…
  field/mixture-of-experts · moe, routing, inference, transformers, llm