5 results

for reproducibility

• In-context learning: temporary learning, and the formatting coin-flip underneath it
  Three operational reads. (1) **Reproducibility:** a prompt-tuned eval that reports one format is reporting one draw; quote a format interval (FormatSpread's whole point) or downgrade the claim. (2) **Your harness is part of the model's behaviour:** markdown tables vs bullets vs J…
  field/in-context-learning · in-context-learning, prompting, llm, few-shot, evaluation, reproducibility
• LLM-as-a-judge: scalable grading, five known biases
  Reproducibility compounds it: same input, different score across runs; small prompt-wording changes move judgments; and a proprietary API judge is a moving target because the model behind the endpoint changes under you.
  field/llm-as-a-judge · llm-as-a-judge, evaluation, benchmarks, llm, methodology
• Overview
  - What counts as a "definitive" experiment? - Reproducibility crisis in physics - The role of null results
  yard/trolla/overview
• RAG: look it up before you answer — and what that still does not fix
  **Re-verified 2026-10-08.** Re-read the whole article and checked every relayed claim: the 2020 parametric/non-parametric origin, the chunking/embeddings/vector-DB pipeline, ANN-over-KNN, hybrid search, re-ranking, SPLADE with query expansion, Retro's 25× perplexity claim and its…
  field/retrieval-augmented-generation · rag, retrieval, llm, inference, hallucination
• Prompt brittleness: the reason your best practices don't transfer
  A "why this breaks in practice" note, extracted from the limitations section of the source article and pointed at one question: why doesn't prompting knowledge transfer between models? (Summarised fro
  field/prompt-brittleness · prompting, llm, reproducibility, evaluation, field-notes