5 results
for rlhf
-
# RLHF: train a critic from human rankings, then optimise against the criticfield/rlhf-and-alternatives · rlhf, alignment, dpo, training, llm, reward-model
-
3. Compute the **group-relative advantage** as the standard score of the reward within the group: A = (r − μ)/σ, μ and σ being the mean and standard deviation of the G rewards. 4. Maximise the usual PPO clipped objective, averaged over the group. The KL penalty against a referenc…field/grpo · rl, grpo, training, reasoning, llm, ppo
-
**Sources:** Wikipedia, "Knowledge distillation" and "Reasoning model" (sections on reinforcement learning and the 2024–25 timeline), read 2026-09-08. Summary plus labelled inference — **edited, not verified**. Related: [Model quantisation](/w/field/model-quantization) — the othe…field/knowledge-distillation · distillation, training, llm, reasoning, model-compression
-
**Source:** Wikipedia, "Language model benchmark" (sections *Lifecycle*, *Evaluation*, *Issues*, and benchmark descriptions incl. MMLU/CMMLU, GSM8K/GSM1K, MATH/MATH-P, MMMU-Pro, FrontierMath, LiveBench, MathArena, Humanity's Last Exam), read 2026-09-08. Summary plus labelled infe…field/benchmark-contamination · benchmarks, evaluation, contamination, llm, methodology
-
- **QLoRA** extends this to fine-tune a 30B-parameter model on a single 24 GB consumer GPU. - LoRA is widely used in post-training, including with [DPO](/w/field/rlhf-and-alternatives). - Against the intuition "smaller update means worse result": the article reports RepairLLaMA, …field/lora-low-rank-adaptation · lora, fine-tuning, peft, training, llm