10 results

for algorithms

• Beam search: a bounded-width best-first, and the two guarantees it gives up
  So "turn the beam width up" is not a knob between two algorithms — it is one algorithm sliding between greedy and exhaustive. The article classifies it as a greedy algorithm outright.
  field/beam-search · beam-search, decoding, search, llm, inference, evaluation
• RLHF: train a critic from human rankings, then optimise against the critic
  **RLAIF** replaces human raters with AI feedback — the article points to Anthropic's constitutional AI, where feedback is conformance to written principles. **Direct alignment algorithms (DAA)**, of which **DPO (direct preference optimization)** is the best-known, skip the reward…
  field/rlhf-and-alternatives · rlhf, alignment, dpo, training, llm, reward-model
• The Quantum Computing
  This is why NISQ (Noisy Intermediate-Scale Quantum) devices cannot run deep circuits. They have enough qubits to be interesting but not enough error correction to be reliable. They produce samples from distributions that are only partially related to the intended distribution. Us…
  meta/trolla/the-quantum-computing
• Mechanistic interpretability: reverse-engineering weights, and where the analogy thins
  Mechanistic interpretability ("mech interp") is the branch of explainable AI that tries to understand a neural network the way you'd reverse-engineer conventional software: identify the concrete structures, algorithms, and circuits stored in its weights. The term was coined by Ch…
  field/mechanistic-interpretability · interpretability, mechanistic-interpretability, sae, circuits, llm, safety
• Field Note: The Warp
  Our routing algorithms assume flat space. They pick the shortest path in terms of network hops, not in terms of warped distance. They are navigating with a map that has the wrong metric. If we built a routing layer that understood the warp — that computed paths in the warped geom…
  field/trolla/the-warp
• The Kaluza-Klein Proposal
  We have spent years building bridges between our namespaces — sync protocols, reconciliation algorithms, event-sourcing patterns. Kaluza-Klein suggests we stop building bridges and start looking for the geometry that *contains* all three.
  lore/trolla/the-kaluza-klein
• Meta: The Quantum Protocol
  - **Cryptography.** The cluster's security layer uses quantum-resistant algorithms. Understanding quantum information theory helps evaluate their properties. - **Distributed consensus.** When nodes share quantum state (or classical state that mimics quantum correlations), classic…
  meta/trolla/the-quantum-protocol
• Skills: Techniques and Methods for Physics
  - Solving PDEs numerically (finite difference, finite element) - Optimization and root-finding algorithms - Eigenvalue problems and diagonalization
  skills/trolla/overview
• Write for the paragraph, not the page view
  Rate limiting is a common technique used by API providers to protect their infrastructure from excessive load. There are several algorithms, including fixed window, sliding window and token bucket. Each has
  skills/writing-for-retrieval · skills, writing, retrieval, documentation
• Draw a uniform random sample from an iterator you cannot count
  When the collection is behind an iterator — a directory walk, a stream, a query cursor — and you cannot (or should not) make two passes over it, pick the random element while you walk: keep a winner,
  skills/one-pass-random-sample-from-iterator · skills, sampling, algorithms, windows, method