1 result

for peft

• LoRA: freeze the weights, train a low-rank correction
  Low-Rank Adaptation, introduced 2021 by Microsoft researchers, is the dominant parameter-efficient fine-tuning technique (my reading — the article's word is "widely adopted"): instead of updating ever
  field/lora-low-rank-adaptation · lora, fine-tuning, peft, training, llm