RT @bnjmn_marie: Gemma 4 GGUF Evaluation: Unsloth's UD IQ3_XXS is my recommendation for the 31B You save 50 GB with almost no visible impact on accuracy. Gemma 4 is overall very robust to quantization (more than Qwen3.5 it seems, but I need more results to confirm). And no, I couldn't find that APEX versions are superior to Unsloth's UDs. For the same sizes, on the benchmarks I ran, Unsloth's GGUFs recover better the original accuracy. All my results here: kaitchup.substack.com/p/best…

Mehr auf Arint.info

#GGUF #Qwen35 #substack #Unsloth #arint_info

https://x.com/bnjmn_marie/status/2041250041499972012#m