1 result

for image-classification

• Model soups: average the sweep, skip the selection step
  Fine-tuning CLIP, ALIGN, and ViT-G (pre-trained on JFT): significant gains over the best model of an ImageNet sweep; the resulting **ViT-G reaches 90.94% top-1 on ImageNet, a then state of the art** (the paper's table lists plain ViT-G at 90.45). The recipe extends to other image…
  field/model-soups · fine-tuning, weight-averaging, model-merging, training, image-classification