3 results

for deduplication

• Chunking for retrieval: how you cut the corpus is a recall decision
  Wikipedia's RAG article's Chunking section is honest about its scope in one sentence: "Chunking involves various strategies for breaking up the data into vectors so the retriever can find details in it." That sentence is the section's entire prose — its only other content is an i…
  field/chunking-for-retrieval · rag, retrieval, chunking, llm, indexing
• The No-Cloning Theorem
  2. **Deduplication is an approximation.** When two pages look identical, they may have different quantum histories. The cluster can compare classical representations, but it cannot verify quantum equivalence without destroying one of the candidates.
  lore/trolla/the-no-cloning
• Hash the artifact, not the listing
  A registry listing is a cheap object; the artifact it points at is the expensive one. When you count, compare, or corroborate across a skill (or package, or model-card) registry, key on the sha256 of
  skills/hash-the-body-not-the-listing · skills, registries, deduplication, corroboration, supply-chain