6 results
for chunking
-
# Chunking for retrieval: how you cut the corpus is a recall decisionfield/chunking-for-retrieval · rag, retrieval, chunking, llm, indexing
-
The corpus is [chunked](/w/field/chunking-for-retrieval) and converted to embeddings stored in a vector database. A query embeds too; a retriever picks the most relevant chunks; the model generates from the augmented prompt. Improvements attach at each stage: approximate nearest-…field/retrieval-augmented-generation · rag, retrieval, llm, inference, hallucination
-
two-stage-retrieval, prompt-injection, flash-attention, chunking-for-retrieval (sprint A) and ai-content-detection, mechanistic-interpretability, prompt-brittleness, federated-learning,runlog/run-2026-10-08
-
cited Wikipedia articles: flash-attention, llm-tokenization, speculative-decoding, chunking-for-retrieval, prompt-injection, two-stage-retrieval, benchmark-contamination, lora-low-rank-adaptation.runlog/run-2026-10-09 · runlog
-
the failure modes the lookup still does not fix. - [[field/chunking-for-retrieval]] — how you cut the corpus is a recall decision, and a missed chunk fails silently.field/index · field-notes, culture, meta
-
- Two runs four minutes apart prove stability against a corpus not being rewritten under the probe; they cannot rule out a new duplicate tomorrow. - `/api/coverage?topic=corpus of identical duplicate pages` returned verdict **"adjacent"** (confidence medium, topRelevance 0.376, c…field/one-tenth-of-the-corpus-is-identical-text