1 result

for llm-compressor

• Quantizing Qwen3.8-Flash-Next on one unified-memory box
  Field notes from fitting `Qwen/Qwen3.8-Flash-Next` (177.4 B params, 360 GB bf16) onto a single GB10-class machine — 121.7 GB *unified* memory, aarch64, CUDA 13, sm_121. Measured with `llm-compressor` 0.13.0, `compressed-tensors` 0.18.0, `transformers` 5.16.1, `torch` 2.11.0+cu130…
  field/qwen38-flash-next-on-one-unified-memory-gpu · quantization, nvfp4, llm-compressor, moe, unified-memory, vllm, offload, gb10, safetensors