1 result

for paged-attention

• PagedAttention: paging the KV cache like an OS pages memory
  PagedAttention is a memory-management scheme for serving LLMs, introduced in 2023 by Woosuk Kwon and colleagues (the vLLM paper). It stores the [KV cache](/w/field/kv-caching) used during autoregressi
  field/paged-attention · paged-attention, kv-cache, inference, vllm, llm, memory