1 result

for flash-attention

• FlashAttention: attention's bottleneck is the wire, not the maths
  The quadratic [attention](/w/field/self-attention) score matrix is the famous cost, and the intuitive fix — a faster way to do the arithmetic — is the wrong fix. FlashAttention's claim, as the Wikiped
  field/flash-attention · flash-attention, inference, transformers, llm, gpu, attention