Ryzen AI Max+ 395 / Radeon 8060S

Quants grouped by model

All 1,525 benchmark configurations, grouped into one table per model family. Each quant contains PP512, PP1024, PP2048, PP4096, and TG128 at five context depths.

9Families
61Quants
1,525Configurations
2-4Samples used

Model family

Gemma 4 26B A4B

2 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
UD-Q6_K_XLgemma-4-26B-A4B-it-UD-Q6_K_XL01701.23+/- 20.401959.72+/- 9.701892.31+/- 1.091742.21+/- 11.6446.07+/- 0.02
12k1074.23+/- 27.891196.20+/- 30.571188.89+/- 7.701156.03+/- 1.2640.19+/- 0.00
32k700.17+/- 11.58758.48+/- 5.99754.48+/- 1.92733.66+/- 6.3137.72+/- 0.01
64k448.36+/- 5.63484.16+/- 1.10482.15+/- 1.70474.15+/- 0.3034.18+/- 0.00
128k262.44+/- 1.48277.16+/- 0.26277.92+/- 0.83275.44+/- 1.3828.74+/- 0.02
UD-Q8_K_XLgemma-4-26B-A4B-it-UD-Q8_K_XL01873.02+/- 6.202137.01+/- 2.292093.00+/- 3.261916.35+/- 4.4743.12+/- 0.01
12k1158.49+/- 1.551283.34+/- 1.231276.22+/- 0.761230.47+/- 1.5337.89+/- 0.01
32k735.85+/- 1.01802.64+/- 2.00796.07+/- 0.31769.63+/- 3.8435.79+/- 0.01
64k464.29+/- 0.15499.11+/- 1.32494.76+/- 2.04486.50+/- 0.5032.54+/- 0.00
128k266.46+/- 0.65281.33+/- 0.40282.04+/- 0.34279.50+/- 0.0927.56+/- 0.01
Back to top

Model family

Gemma 4 E2B

6 canonical quantization files

DENSEUB 512
QuantDepthPP512PP1024PP2048PP4096TG128
UD-Q2_K_XLgemma-4-E2B-it-UD-Q2_K_XL03459.77+/- 3.053352.77+/- 1.713247.79+/- 1.933081.24+/- 1.79116.77+/- 0.02
12k1997.07+/- 69.222008.45+/- 0.551994.46+/- 4.461918.68+/- 0.85100.89+/- 0.05
32k1170.98+/- 23.881188.97+/- 0.221176.57+/- 0.971155.39+/- 0.1990.15+/- 0.09
64k717.02+/- 11.76721.25+/- 1.33713.66+/- 1.23705.37+/- 0.4876.53+/- 0.02
128k404.06+/- 3.76402.63+/- 0.59402.46+/- 0.70399.81+/- 0.3658.71+/- 0.01
UD-Q3_K_XLgemma-4-E2B-it-UD-Q3_K_XL03908.91+/- 0.363757.91+/- 9.393623.93+/- 6.093421.41+/- 4.13103.28+/- 0.01
12k2135.19+/- 71.282178.95+/- 1.472105.42+/- 1.092069.13+/- 0.8390.71+/- 0.02
32k1227.17+/- 23.291237.05+/- 1.931222.13+/- 1.281198.05+/- 0.6381.98+/- 0.06
64k737.23+/- 9.85736.47+/- 0.49731.65+/- 1.33722.76+/- 0.3770.56+/- 0.01
128k410.91+/- 2.13407.85+/- 1.37408.49+/- 0.14405.26+/- 0.2755.26+/- 0.02
UD-Q4_K_XLgemma-4-E2B-it-UD-Q4_K_XL03997.32+/- 6.903856.35+/- 6.683710.90+/- 2.673501.98+/- 0.9794.26+/- 0.01
12k2198.69+/- 80.302220.94+/- 7.072182.19+/- 2.572105.21+/- 0.5083.70+/- 0.03
32k1234.06+/- 26.101245.21+/- 0.951229.79+/- 2.281204.72+/- 0.5876.16+/- 0.03
64k739.48+/- 8.67741.88+/- 1.64735.14+/- 0.64727.55+/- 0.3466.18+/- 0.01
128k412.31+/- 1.73409.75+/- 0.38409.95+/- 0.59407.05+/- 0.2052.57+/- 0.03
UD-Q5_K_XLgemma-4-E2B-it-UD-Q5_K_XL03910.50+/- 4.323794.60+/- 1.873653.55+/- 3.793452.88+/- 1.0186.82+/- 0.01
12k2170.22+/- 78.262195.95+/- 1.372162.06+/- 0.082081.80+/- 1.2377.71+/- 0.02
32k1232.03+/- 27.311236.29+/- 2.051226.38+/- 1.731199.34+/- 0.6271.15+/- 0.01
64k732.73+/- 14.08737.96+/- 1.68730.74+/- 0.27723.24+/- 0.9362.35+/- 0.01
128k411.05+/- 2.46407.12+/- 1.48407.89+/- 0.82405.57+/- 0.2350.13+/- 0.02
UD-Q6_K_XLgemma-4-E2B-it-UD-Q6_K_XL03655.05+/- 6.303532.22+/- 8.503410.75+/- 2.973233.07+/- 1.6776.92+/- 0.01
12k2073.72+/- 82.092105.63+/- 2.072071.35+/- 0.311989.72+/- 0.9969.78+/- 0.02
32k1201.40+/- 25.561209.30+/- 0.881195.83+/- 1.811173.68+/- 0.7864.50+/- 0.02
64k724.46+/- 12.32730.21+/- 0.92721.18+/- 2.26713.59+/- 0.3257.23+/- 0.01
128k407.81+/- 4.50404.60+/- 0.70405.55+/- 0.84402.35+/- 0.4746.73+/- 0.00
UD-Q8_K_XLgemma-4-E2B-it-UD-Q8_K_XL04424.69+/- 10.664258.63+/- 11.934092.84+/- 3.353835.27+/- 1.9266.50+/- 0.01
12k2318.10+/- 85.372345.33+/- 0.982307.81+/- 1.992218.03+/- 1.3761.10+/- 0.01
32k1275.44+/- 25.311286.40+/- 1.021271.46+/- 0.911247.16+/- 1.7457.03+/- 0.02
64k754.45+/- 6.26756.87+/- 1.15750.26+/- 0.66740.28+/- 0.8851.23+/- 0.01
128k417.19+/- 4.06412.98+/- 0.31414.36+/- 0.64410.66+/- 0.2342.62+/- 0.00
Back to top

Model family

GPT-OSS 20B

1 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
UD-Q8_K_XLgpt-oss-20b-UD-Q8_K_XL01924.99+/- 18.562291.17+/- 5.372418.22+/- 7.752352.24+/- 11.0763.10+/- 0.01
12k1472.07+/- 42.871686.36+/- 18.901763.13+/- 11.391728.55+/- 1.9855.67+/- 0.01
32k947.37+/- 14.831079.57+/- 7.581146.88+/- 4.371124.46+/- 0.4147.24+/- 0.01
64k598.79+/- 2.43657.94+/- 2.97720.38+/- 3.58712.21+/- 5.2937.91+/- 0.00
128k333.63+/- 2.79354.74+/- 5.20375.52+/- 6.52378.72+/- 2.6827.32+/- 0.00
Back to top

Model family

Laguna XS 2.1

1 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
Q4_K_MLaguna-XS-2.1-Q4_K_M01970.66+/- 4.832118.14+/- 3.282036.32+/- 3.421925.60+/- 2.7573.03+/- 0.10
12k1288.84+/- 60.601392.80+/- 36.761333.20+/- 17.001299.71+/- 1.5853.24+/- 0.02
32k746.57+/- 24.12842.72+/- 11.48812.10+/- 5.19797.32+/- 1.1133.04+/- 0.04
64k453.15+/- 7.23495.53+/- 2.41492.16+/- 0.59485.53+/- 0.2718.89+/- 0.01
128k257.81+/- 2.63271.54+/- 2.05271.90+/- 1.95269.27+/- 0.909.69+/- 0.01
Back to top

Model family

Ling 3.0 Tiny

4 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
Q4_K_MLing-3.0-tiny-Q4_K_M04747.30+/- 13.125090.82+/- 10.824845.76+/- 1.684316.78+/- 6.16112.15+/- 0.04
12k1883.68+/- 133.141935.64+/- 60.371862.99+/- 32.461770.00+/- 5.31103.04+/- 0.02
32k957.72+/- 35.12999.20+/- 24.18949.15+/- 8.18942.36+/- 11.0097.64+/- 0.04
64k536.31+/- 10.55539.26+/- 5.52524.05+/- 7.06521.78+/- 5.7986.00+/- 0.01
128k286.92+/- 3.36293.93+/- 2.07283.57+/- 3.32277.42+/- 3.7070.60+/- 0.01
Q5_K_MLing-3.0-tiny-Q5_K_M04604.18+/- 5.835065.78+/- 9.274775.19+/- 14.734260.28+/- 13.10106.60+/- 0.04
12k1868.84+/- 134.151921.93+/- 78.431848.59+/- 31.021756.66+/- 17.5098.21+/- 0.24
32k952.79+/- 33.721004.36+/- 21.24941.89+/- 18.42910.61+/- 8.8193.58+/- 0.02
64k534.85+/- 10.43548.08+/- 3.28531.38+/- 13.20522.90+/- 1.8582.74+/- 0.02
128k286.24+/- 3.14291.95+/- 3.07279.54+/- 2.88279.60+/- 2.2268.33+/- 0.06
Q6_KLing-3.0-tiny-Q6_K04061.87+/- 4.014607.63+/- 9.844332.11+/- 9.913905.92+/- 2.38105.16+/- 0.03
12k1753.40+/- 160.651852.93+/- 77.021759.57+/- 60.381700.23+/- 13.9897.29+/- 0.05
32k913.57+/- 39.86953.39+/- 25.96904.65+/- 7.82897.00+/- 12.7591.98+/- 0.05
64k520.50+/- 14.18537.20+/- 3.62512.26+/- 2.04512.26+/- 4.3081.60+/- 0.00
128k283.72+/- 4.28287.64+/- 2.16276.07+/- 2.41276.85+/- 3.2867.69+/- 0.02
Q8_0Ling-3.0-tiny-Q8_004660.81+/- 11.895192.49+/- 17.884986.89+/- 7.584446.82+/- 8.3898.00+/- 0.08
12k1876.44+/- 127.591973.66+/- 91.351861.84+/- 50.671793.27+/- 11.1391.43+/- 0.05
32k951.54+/- 37.891011.42+/- 16.44964.81+/- 11.09922.71+/- 10.2987.12+/- 0.10
64k535.31+/- 9.33548.07+/- 4.00525.56+/- 4.36525.42+/- 7.8877.69+/- 0.02
128k286.41+/- 2.78294.14+/- 3.90281.25+/- 5.67283.04+/- 2.7065.30+/- 0.01
Back to top

Model family

Qwen3.5 0.8B

22 canonical quantization files

DENSEUB 512
QuantDepthPP512PP1024PP2048PP4096TG128
BF16Qwen3.5-0.8B-BF1609347.51+/- 21.209370.91+/- 56.059294.52+/- 17.108970.63+/- 34.96107.25+/- 0.01
12k6240.18+/- 565.076631.33+/- 8.446554.63+/- 21.546344.24+/- 12.0099.52+/- 0.02
32k4003.99+/- 242.254145.29+/- 5.134135.20+/- 5.854060.88+/- 2.2990.52+/- 0.03
64k2593.33+/- 101.562656.52+/- 1.642639.83+/- 0.562610.56+/- 1.0177.41+/- 0.01
128k1539.45+/- 36.581543.14+/- 0.281546.51+/- 0.161536.10+/- 0.5561.40+/- 0.01
IQ4_NLQwen3.5-0.8B-IQ4_NL010395.37+/- 119.3710237.23+/- 11.0010127.87+/- 30.789779.83+/- 12.39225.37+/- 0.15
12k6779.13+/- 448.797005.24+/- 13.476896.61+/- 14.686691.28+/- 11.42192.34+/- 0.10
32k4220.92+/- 187.804315.09+/- 0.994283.82+/- 5.144214.71+/- 0.10161.06+/- 0.01
64k2687.97+/- 68.862729.24+/- 2.162709.01+/- 2.012679.58+/- 0.52124.99+/- 0.08
128k1569.42+/- 27.321566.67+/- 1.691567.53+/- 2.351556.21+/- 0.8887.89+/- 0.03
IQ4_XSQwen3.5-0.8B-IQ4_XS010538.20+/- 100.0610354.53+/- 27.7310281.13+/- 23.139937.45+/- 11.72229.66+/- 0.12
12k6866.75+/- 483.587070.70+/- 15.746967.70+/- 3.946754.46+/- 3.43195.43+/- 0.23
32k4253.32+/- 176.064344.80+/- 5.094315.06+/- 8.144240.79+/- 8.93162.99+/- 0.07
64k2695.25+/- 72.002737.55+/- 3.362678.44+/- 4.882637.28+/- 1.24126.10+/- 0.02
128k1574.60+/- 22.951570.21+/- 1.241570.79+/- 0.641560.92+/- 0.3488.38+/- 0.02
Q3_K_MQwen3.5-0.8B-Q3_K_M010024.49+/- 109.179982.80+/- 61.439802.12+/- 16.979486.80+/- 31.04223.22+/- 0.19
12k6625.33+/- 426.066877.35+/- 6.966747.34+/- 6.446531.07+/- 30.69190.77+/- 0.01
32k4178.85+/- 174.844249.13+/- 5.754148.29+/- 48.654042.66+/- 5.93158.90+/- 0.13
64k2664.58+/- 73.572700.07+/- 3.772643.63+/- 1.882605.30+/- 0.78123.78+/- 0.03
128k1561.79+/- 22.081558.96+/- 1.841559.10+/- 0.781550.01+/- 0.3687.07+/- 0.03
Q3_K_SQwen3.5-0.8B-Q3_K_S09830.88+/- 103.489785.24+/- 59.499598.84+/- 21.749285.40+/- 9.14231.73+/- 0.37
12k6591.61+/- 466.596747.42+/- 1.726653.28+/- 12.916375.73+/- 22.69197.00+/- 0.04
32k4146.72+/- 175.464203.77+/- 13.014095.66+/- 8.713997.89+/- 2.16162.94+/- 0.07
64k2638.94+/- 100.142685.50+/- 1.192623.09+/- 1.542584.90+/- 2.78126.12+/- 0.11
128k1559.84+/- 23.671556.05+/- 0.801554.60+/- 1.111544.24+/- 0.4988.26+/- 0.01
Q4_0Qwen3.5-0.8B-Q4_0010225.03+/- 102.8510174.93+/- 83.8410007.88+/- 37.359650.79+/- 27.84226.32+/- 0.12
12k6735.20+/- 447.246949.79+/- 18.096844.64+/- 11.176629.41+/- 23.30193.10+/- 0.04
32k4215.66+/- 173.424292.05+/- 2.544226.73+/- 22.664091.42+/- 8.67161.59+/- 0.04
64k2677.46+/- 75.522711.30+/- 1.632658.89+/- 2.582615.82+/- 3.27125.33+/- 0.08
128k1566.73+/- 24.781564.06+/- 0.701563.96+/- 0.791553.69+/- 0.1588.04+/- 0.03
Q4_1Qwen3.5-0.8B-Q4_109994.61+/- 98.539761.29+/- 6.279712.56+/- 26.779427.17+/- 5.45221.12+/- 0.09
12k6615.17+/- 436.396792.72+/- 7.336716.00+/- 10.286518.39+/- 5.64188.93+/- 0.24
32k4152.63+/- 183.054235.63+/- 1.684207.94+/- 1.344099.59+/- 30.62158.89+/- 0.05
64k2653.18+/- 72.502687.22+/- 3.642647.87+/- 9.112599.88+/- 0.48123.71+/- 0.03
128k1559.82+/- 21.611555.98+/- 0.861557.26+/- 0.901546.92+/- 0.6387.21+/- 0.02
Q4_K_MQwen3.5-0.8B-Q4_K_M010040.23+/- 12.899975.10+/- 35.609883.53+/- 30.069571.34+/- 15.69212.83+/- 0.04
12k6694.87+/- 506.906928.54+/- 4.246825.18+/- 9.486610.66+/- 7.71182.89+/- 0.05
32k4190.81+/- 190.814279.11+/- 4.534243.11+/- 1.384173.68+/- 2.22153.69+/- 0.16
64k2667.65+/- 84.932710.77+/- 3.892693.01+/- 1.842665.38+/- 0.50120.36+/- 0.03
128k1564.15+/- 27.801562.13+/- 0.641563.05+/- 0.731552.57+/- 0.6185.60+/- 0.01
Q4_K_SQwen3.5-0.8B-Q4_K_S010257.80+/- 104.3610160.37+/- 32.0010052.06+/- 66.169675.55+/- 11.96216.47+/- 0.16
12k6773.50+/- 456.226970.41+/- 15.596888.48+/- 12.886648.95+/- 1.55185.44+/- 0.04
32k4214.46+/- 174.584298.07+/- 7.374248.20+/- 13.014105.87+/- 5.07155.53+/- 0.04
64k2678.99+/- 72.942713.04+/- 3.222662.00+/- 3.912617.16+/- 1.91121.67+/- 0.02
128k1567.36+/- 24.401564.28+/- 0.741563.63+/- 0.651554.50+/- 1.3386.13+/- 0.02
Q5_K_MQwen3.5-0.8B-Q5_K_M09664.03+/- 13.809607.41+/- 17.099520.69+/- 29.379258.22+/- 20.54203.99+/- 0.19
12k6507.57+/- 513.686749.82+/- 4.276639.85+/- 8.396454.83+/- 2.60176.86+/- 0.08
32k4110.12+/- 205.274208.49+/- 5.754163.89+/- 13.174023.75+/- 7.44149.52+/- 0.05
64k2633.68+/- 84.472677.57+/- 0.872629.45+/- 3.222587.41+/- 0.89117.66+/- 0.08
128k1553.48+/- 29.271550.84+/- 0.701551.73+/- 0.231541.40+/- 0.3884.28+/- 0.02
Q5_K_SQwen3.5-0.8B-Q5_K_S010068.40+/- 10.0210035.23+/- 13.979905.38+/- 14.859612.09+/- 16.69207.12+/- 0.15
12k6675.01+/- 493.586911.56+/- 13.916830.86+/- 15.036600.97+/- 4.60179.03+/- 0.04
32k4187.39+/- 189.974274.06+/- 3.394219.49+/- 7.344076.04+/- 8.45151.25+/- 0.10
64k2669.74+/- 79.002711.04+/- 2.882652.78+/- 2.792610.84+/- 1.00118.65+/- 0.03
128k1562.74+/- 28.421560.86+/- 0.801562.78+/- 1.061552.37+/- 0.3084.86+/- 0.00
Q6_KQwen3.5-0.8B-Q6_K09278.09+/- 84.689177.17+/- 34.359070.28+/- 7.978812.08+/- 22.62199.01+/- 0.04
12k6227.95+/- 598.106511.96+/- 14.496443.73+/- 2.526242.80+/- 4.81173.12+/- 0.13
32k3983.94+/- 255.864121.10+/- 3.984086.09+/- 2.343948.71+/- 10.06146.91+/- 0.05
64k2588.58+/- 104.692641.48+/- 1.962594.19+/- 6.212557.22+/- 2.30116.08+/- 0.02
128k1537.98+/- 39.661539.51+/- 0.701539.40+/- 1.361529.44+/- 0.1983.32+/- 0.01
Q8_0Qwen3.5-0.8B-Q8_0010846.53+/- 13.6010712.40+/- 26.4910650.77+/- 23.7910224.93+/- 13.17183.80+/- 0.04
12k7003.71+/- 490.737188.28+/- 26.987102.82+/- 32.096908.95+/- 11.31161.89+/- 0.05
32k4318.05+/- 189.324392.19+/- 2.964365.83+/- 4.304278.79+/- 10.30139.06+/- 0.13
64k2716.63+/- 71.192748.84+/- 2.682693.58+/- 0.382650.44+/- 0.96111.82+/- 0.05
128k1579.57+/- 24.141577.15+/- 0.711577.55+/- 1.071563.50+/- 0.2980.85+/- 0.02
UD-IQ2_MQwen3.5-0.8B-UD-IQ2_M09769.47+/- 16.759667.38+/- 45.039555.49+/- 8.629268.38+/- 11.45233.68+/- 0.47
12k6551.15+/- 436.436705.06+/- 15.686626.28+/- 6.256429.66+/- 24.13198.90+/- 0.01
32k4116.76+/- 170.124198.88+/- 1.394126.07+/- 28.683994.20+/- 7.37163.61+/- 0.16
64k2643.07+/- 68.262670.58+/- 9.662602.29+/- 2.372567.85+/- 1.03126.65+/- 0.05
128k1553.05+/- 23.911550.94+/- 2.431551.79+/- 1.231538.13+/- 0.4188.26+/- 0.01
UD-IQ2_XXSQwen3.5-0.8B-UD-IQ2_XXS010111.63+/- 88.719965.10+/- 30.479878.31+/- 36.119583.89+/- 39.69241.68+/- 0.40
12k6704.91+/- 500.096915.31+/- 13.386797.38+/- 4.606548.78+/- 49.20204.11+/- 0.14
32k4187.22+/- 189.854266.37+/- 5.644202.21+/- 15.754069.53+/- 6.24167.19+/- 0.26
64k2666.70+/- 72.562701.85+/- 3.122646.78+/- 5.552602.87+/- 1.51128.69+/- 0.05
128k1558.15+/- 24.911559.74+/- 0.361559.97+/- 0.201549.59+/- 0.2789.22+/- 0.02
UD-IQ3_XXSQwen3.5-0.8B-UD-IQ3_XXS010167.70+/- 2.0110012.35+/- 46.029915.12+/- 18.549603.02+/- 7.34232.39+/- 0.47
12k6678.18+/- 553.146891.46+/- 3.506828.04+/- 14.126640.00+/- 5.14197.84+/- 0.13
32k4160.16+/- 221.154260.90+/- 5.784214.33+/- 5.704070.68+/- 4.77163.21+/- 0.13
64k2660.98+/- 84.312700.07+/- 2.182642.58+/- 1.862603.46+/- 2.26126.37+/- 0.07
128k1564.42+/- 30.401560.88+/- 0.761560.55+/- 0.251550.06+/- 0.5588.15+/- 0.03
UD-Q2_K_XLQwen3.5-0.8B-UD-Q2_K_XL09613.28+/- 89.019461.28+/- 9.839359.81+/- 29.279073.34+/- 13.41232.30+/- 0.28
12k6415.67+/- 500.906666.30+/- 7.636592.20+/- 3.066381.35+/- 4.85197.28+/- 0.05
32k4071.60+/- 211.784166.14+/- 17.794112.02+/- 12.543986.31+/- 6.67162.98+/- 0.10
64k2625.05+/- 88.142666.14+/- 2.272618.43+/- 1.392577.96+/- 0.76126.27+/- 0.03
128k1549.95+/- 28.251547.96+/- 1.341548.44+/- 1.731537.11+/- 0.5088.24+/- 0.01
UD-Q3_K_XLQwen3.5-0.8B-UD-Q3_K_XL010179.50+/- 159.8910129.43+/- 60.639973.01+/- 26.409650.75+/- 15.48221.92+/- 0.20
12k6721.87+/- 496.206956.14+/- 4.696865.35+/- 11.126671.49+/- 8.31189.68+/- 0.07
32k4193.78+/- 208.314300.15+/- 10.594204.06+/- 26.974083.19+/- 7.03158.38+/- 0.02
64k2673.34+/- 87.432712.45+/- 1.872653.38+/- 1.582615.25+/- 3.48123.20+/- 0.03
128k1569.76+/- 30.341564.38+/- 0.401567.34+/- 0.771552.72+/- 2.1786.96+/- 0.02
UD-Q4_K_XLQwen3.5-0.8B-UD-Q4_K_XL010213.97+/- 19.9810166.30+/- 37.9410039.45+/- 61.949728.27+/- 28.12210.91+/- 0.13
12k6748.09+/- 547.856993.60+/- 20.256899.63+/- 5.806666.88+/- 2.66181.41+/- 0.04
32k4215.75+/- 207.154316.11+/- 5.704237.95+/- 20.584099.76+/- 3.39152.76+/- 0.05
64k2683.89+/- 85.912727.23+/- 2.212663.47+/- 0.612622.30+/- 2.70119.66+/- 0.02
128k1573.74+/- 28.551566.99+/- 0.471566.31+/- 0.431559.06+/- 0.8885.34+/- 0.01
UD-Q5_K_XLQwen3.5-0.8B-UD-Q5_K_XL09328.31+/- 60.089251.03+/- 29.769161.85+/- 37.488887.61+/- 21.03203.75+/- 0.16
12k6307.24+/- 545.806590.98+/- 5.336500.06+/- 3.446293.87+/- 5.71176.35+/- 0.03
32k4025.37+/- 221.624142.79+/- 2.304116.80+/- 3.773971.90+/- 5.12149.33+/- 0.08
64k2606.24+/- 106.252660.07+/- 2.382606.75+/- 5.332566.83+/- 0.59117.49+/- 0.05
128k1541.81+/- 34.691543.01+/- 0.591542.25+/- 0.851535.10+/- 1.0084.15+/- 0.03
UD-Q6_K_XLQwen3.5-0.8B-UD-Q6_K_XL010178.73+/- 15.9810051.73+/- 19.809987.90+/- 5.619681.45+/- 12.76181.68+/- 0.04
12k6648.65+/- 663.296990.57+/- 5.226858.88+/- 18.816653.47+/- 11.87159.91+/- 0.14
32k4155.04+/- 253.044288.95+/- 2.004255.80+/- 1.524187.38+/- 1.57137.39+/- 0.06
64k2658.00+/- 101.732712.16+/- 2.292672.96+/- 8.322620.72+/- 1.16110.43+/- 0.04
128k1564.58+/- 37.651563.77+/- 2.291562.34+/- 0.581554.78+/- 0.2680.31+/- 0.03
UD-Q8_K_XLQwen3.5-0.8B-UD-Q8_K_XL09887.01+/- 10.849911.96+/- 39.109819.64+/- 17.019477.24+/- 29.92133.97+/- 0.00
12k6551.56+/- 536.336882.64+/- 10.916808.66+/- 13.766600.32+/- 16.74122.02+/- 0.04
32k4137.79+/- 213.754255.33+/- 6.664245.52+/- 2.484165.30+/- 2.42108.74+/- 0.01
64k2643.90+/- 83.772698.98+/- 1.282682.39+/- 1.492615.94+/- 5.1990.81+/- 0.06
128k1555.97+/- 27.681558.39+/- 1.371561.49+/- 0.581551.37+/- 0.8669.35+/- 0.01
Back to top

Model family

Qwen3.6 35B A3B

23 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
MXFP4_MOEQwen3.6-35B-A3B-MXFP4_MOE01700.50+/- 5.902044.12+/- 4.882281.68+/- 1.402216.32+/- 4.5361.41+/- 0.02
12k1299.64+/- 73.891545.36+/- 47.321703.27+/- 25.891662.99+/- 1.7057.05+/- 0.01
32k905.03+/- 34.721033.35+/- 21.951110.75+/- 13.721102.32+/- 1.3752.07+/- 0.00
64k633.64+/- 17.95689.61+/- 11.94726.84+/- 2.80719.33+/- 0.9345.31+/- 0.00
128k395.81+/- 7.85415.00+/- 4.25427.13+/- 1.76426.21+/- 0.5935.99+/- 0.00
Q8_0Qwen3.6-35B-A3B-Q8_001889.06+/- 94.492264.90+/- 4.042448.71+/- 1.022377.30+/- 2.0553.49+/- 0.02
12k1442.39+/- 86.871675.92+/- 63.481801.85+/- 32.971758.97+/- 2.4450.21+/- 0.01
32k971.30+/- 40.351082.40+/- 29.551154.77+/- 15.591135.91+/- 2.1946.43+/- 0.00
64k656.62+/- 29.44713.52+/- 12.34745.36+/- 5.94734.42+/- 0.6640.97+/- 0.00
128k406.57+/- 7.66422.05+/- 3.85432.93+/- 2.86431.41+/- 0.1133.18+/- 0.00
UD-IQ1_MQwen3.6-35B-A3B-UD-IQ1_M01389.22+/- 6.621759.27+/- 7.882034.68+/- 5.821996.03+/- 1.8874.05+/- 0.02
12k1097.90+/- 52.721365.04+/- 49.411561.21+/- 35.581535.61+/- 2.0967.36+/- 0.02
32k803.92+/- 30.69943.57+/- 26.561041.91+/- 8.621026.71+/- 1.6260.54+/- 0.01
64k583.34+/- 17.30653.04+/- 11.21702.04+/- 6.50695.01+/- 0.1951.57+/- 0.01
128k375.90+/- 7.78400.81+/- 4.23418.20+/- 2.71416.49+/- 0.5239.82+/- 0.02
UD-IQ2_MQwen3.6-35B-A3B-UD-IQ2_M01382.85+/- 13.101742.08+/- 16.082031.72+/- 11.971982.65+/- 0.6073.86+/- 0.04
12k1078.15+/- 69.341360.73+/- 50.801559.17+/- 30.651528.99+/- 4.2867.31+/- 0.02
32k793.70+/- 35.18939.03+/- 21.611042.23+/- 13.881026.14+/- 1.2160.40+/- 0.02
64k581.53+/- 17.34651.17+/- 10.66701.22+/- 7.12693.22+/- 0.4551.47+/- 0.01
128k375.65+/- 6.77400.93+/- 4.34417.32+/- 2.59416.18+/- 0.0239.75+/- 0.01
UD-IQ2_XXSQwen3.6-35B-A3B-UD-IQ2_XXS01357.86+/- 21.591720.88+/- 9.982019.66+/- 2.971967.08+/- 2.9474.02+/- 0.01
12k1082.93+/- 50.171350.13+/- 44.841546.36+/- 28.591516.78+/- 5.8567.35+/- 0.01
32k787.00+/- 26.56931.68+/- 19.471031.53+/- 9.701022.94+/- 0.5460.43+/- 0.02
64k578.23+/- 17.07648.02+/- 10.89697.87+/- 5.96692.65+/- 0.1251.47+/- 0.02
128k373.06+/- 7.42398.59+/- 3.95416.03+/- 1.87415.38+/- 0.1639.78+/- 0.03
UD-IQ3_SQwen3.6-35B-A3B-UD-IQ3_S01279.71+/- 11.161677.36+/- 7.681936.76+/- 6.721895.27+/- 2.7366.77+/- 0.01
12k1034.74+/- 71.891308.86+/- 60.741500.20+/- 38.951479.09+/- 1.1761.64+/- 0.03
32k758.67+/- 40.24912.34+/- 27.401015.75+/- 12.351002.16+/- 1.1855.74+/- 0.01
64k563.56+/- 24.19640.55+/- 15.36688.43+/- 8.63682.02+/- 0.1148.02+/- 0.00
128k367.95+/- 9.29395.50+/- 5.25412.44+/- 3.07412.26+/- 0.2737.74+/- 0.01
UD-IQ3_XXSQwen3.6-35B-A3B-UD-IQ3_XXS01169.23+/- 47.061615.35+/- 4.691906.29+/- 3.261857.08+/- 1.1466.80+/- 0.02
12k979.34+/- 56.841275.36+/- 50.191479.25+/- 33.731452.32+/- 12.5761.63+/- 0.02
32k730.37+/- 31.19877.92+/- 26.391000.26+/- 10.33991.29+/- 1.8155.32+/- 0.68
64k524.72+/- 32.68631.42+/- 13.56684.46+/- 7.76676.61+/- 4.8547.99+/- 0.00
128k361.52+/- 9.16392.47+/- 5.15410.57+/- 2.28410.50+/- 0.4137.72+/- 0.01
UD-IQ4_NLQwen3.6-35B-A3B-UD-IQ4_NL01844.65+/- 19.552117.01+/- 8.422285.22+/- 2.012218.24+/- 0.7463.75+/- 0.02
12k1387.72+/- 82.091589.30+/- 56.591698.89+/- 30.391661.38+/- 4.3859.10+/- 0.00
32k947.10+/- 41.521043.62+/- 28.271099.33+/- 7.471081.47+/- 2.5553.81+/- 0.00
64k652.02+/- 20.42698.57+/- 11.79727.77+/- 5.13716.51+/- 2.6146.60+/- 0.02
128k403.45+/- 7.75415.96+/- 3.16425.55+/- 1.98425.37+/- 0.1336.81+/- 0.01
UD-IQ4_NL_XLQwen3.6-35B-A3B-UD-IQ4_NL_XL01830.25+/- 78.802189.83+/- 7.582339.60+/- 1.252275.25+/- 3.4162.22+/- 0.03
12k1425.86+/- 88.621627.42+/- 62.231734.80+/- 34.031695.82+/- 2.6957.80+/- 0.01
32k950.05+/- 54.151061.83+/- 31.341112.11+/- 9.321094.83+/- 0.5952.80+/- 0.05
64k661.44+/- 20.46705.25+/- 10.99734.78+/- 5.55723.61+/- 0.7345.87+/- 0.04
128k406.48+/- 7.65419.31+/- 3.94429.42+/- 2.42427.71+/- 0.1636.40+/- 0.01
UD-IQ4_XSQwen3.6-35B-A3B-UD-IQ4_XS01834.88+/- 14.282113.78+/- 9.112272.96+/- 7.812211.89+/- 3.0962.50+/- 0.03
12k1385.65+/- 85.171586.37+/- 56.781693.77+/- 32.351658.04+/- 1.3157.93+/- 0.01
32k948.74+/- 39.921043.33+/- 27.731094.07+/- 14.351079.73+/- 4.0652.96+/- 0.00
64k651.50+/- 20.73697.96+/- 12.37727.46+/- 6.28718.03+/- 0.6146.00+/- 0.00
128k402.72+/- 6.75416.87+/- 4.02426.78+/- 2.41424.99+/- 0.1936.47+/- 0.01
UD-Q2_K_XLQwen3.6-35B-A3B-UD-Q2_K_XL01297.00+/- 18.431659.80+/- 11.321952.94+/- 7.961901.25+/- 2.3771.63+/- 0.01
12k985.25+/- 102.561302.36+/- 48.481504.29+/- 27.901470.52+/- 13.0665.51+/- 0.01
32k748.17+/- 36.34904.79+/- 17.151014.88+/- 11.091002.35+/- 2.0459.08+/- 0.00
64k560.39+/- 23.17638.03+/- 9.93691.89+/- 6.29681.74+/- 0.5850.47+/- 0.03
128k368.48+/- 7.32395.44+/- 3.91414.14+/- 2.25412.60+/- 0.2539.15+/- 0.00
UD-Q3_K_MQwen3.6-35B-A3B-UD-Q3_K_M01521.56+/- 14.661916.11+/- 4.782186.28+/- 2.812125.23+/- 4.8862.59+/- 0.02
12k1199.60+/- 68.041475.47+/- 44.641644.49+/- 32.061609.32+/- 6.5958.09+/- 0.01
32k854.90+/- 39.20985.87+/- 16.481075.08+/- 12.281056.83+/- 2.5953.00+/- 0.00
64k608.80+/- 20.60675.73+/- 9.89716.27+/- 4.51707.34+/- 0.5846.03+/- 0.01
128k385.58+/- 8.19408.84+/- 3.41424.02+/- 2.30422.08+/- 0.0436.50+/- 0.01
UD-Q3_K_SQwen3.6-35B-A3B-UD-Q3_K_S01487.67+/- 26.091869.70+/- 16.892141.62+/- 3.082078.40+/- 9.6062.44+/- 0.01
12k1163.84+/- 46.591446.16+/- 45.381619.44+/- 27.541577.80+/- 12.3757.90+/- 0.01
32k838.89+/- 26.80972.84+/- 17.101060.99+/- 9.501049.65+/- 2.0652.69+/- 0.02
64k601.03+/- 20.99667.60+/- 10.63710.60+/- 4.84701.65+/- 1.8345.77+/- 0.05
128k382.78+/- 5.08406.46+/- 3.50421.89+/- 2.47420.71+/- 0.2536.39+/- 0.00
UD-Q3_K_XLQwen3.6-35B-A3B-UD-Q3_K_XL01555.08+/- 10.831945.04+/- 3.882205.13+/- 5.212139.25+/- 6.7462.89+/- 0.02
12k1209.95+/- 57.791480.94+/- 47.191650.21+/- 29.731608.44+/- 14.2058.30+/- 0.04
32k857.44+/- 34.64991.73+/- 17.601075.52+/- 11.551062.51+/- 3.2953.17+/- 0.01
64k614.77+/- 15.77677.18+/- 11.24717.67+/- 5.30709.92+/- 1.8146.16+/- 0.01
128k387.54+/- 6.18409.74+/- 3.97423.88+/- 1.75422.83+/- 0.1836.57+/- 0.00
UD-Q4_K_MQwen3.6-35B-A3B-UD-Q4_K_M02171.07+/- 20.512335.84+/- 4.512434.74+/- 0.642394.07+/- 3.2560.21+/- 0.01
12k1574.72+/- 111.091707.89+/- 67.101798.40+/- 39.011761.54+/- 2.8756.05+/- 0.00
32k1027.55+/- 48.681097.69+/- 28.111149.23+/- 13.911125.74+/- 6.2751.33+/- 0.05
64k689.87+/- 21.17719.54+/- 12.84746.19+/- 6.31736.05+/- 0.6944.77+/- 0.03
128k415.71+/- 6.95424.83+/- 4.37433.03+/- 1.71431.53+/- 0.3635.67+/- 0.02
UD-Q4_K_SQwen3.6-35B-A3B-UD-Q4_K_S02153.44+/- 65.772366.31+/- 0.872463.68+/- 4.682395.65+/- 2.4361.68+/- 0.02
12k1587.39+/- 113.491727.30+/- 66.381803.46+/- 37.761769.52+/- 4.8157.35+/- 0.01
32k1032.61+/- 46.831104.67+/- 28.691154.39+/- 9.531128.02+/- 3.8552.32+/- 0.00
64k691.75+/- 21.12721.46+/- 12.09745.00+/- 7.54736.39+/- 1.2345.50+/- 0.04
128k417.21+/- 7.90425.51+/- 4.05432.57+/- 2.05431.08+/- 0.1636.12+/- 0.01
UD-Q4_K_XLQwen3.6-35B-A3B-UD-Q4_K_XL02121.08+/- 20.432333.65+/- 6.352450.14+/- 2.072376.80+/- 3.5458.33+/- 0.01
12k1574.35+/- 110.051707.29+/- 64.531795.42+/- 38.731757.83+/- 1.3554.44+/- 0.01
32k1028.42+/- 49.221098.78+/- 27.031145.77+/- 18.161134.30+/- 3.0150.00+/- 0.00
64k681.17+/- 23.46718.45+/- 12.09744.49+/- 6.43734.88+/- 0.5043.77+/- 0.01
128k415.79+/- 7.46424.68+/- 4.53433.03+/- 2.03431.40+/- 0.2535.03+/- 0.01
UD-Q5_K_MQwen3.6-35B-A3B-UD-Q5_K_M02072.81+/- 7.592213.29+/- 1.402382.47+/- 1.062309.88+/- 3.1755.97+/- 0.00
12k1522.87+/- 104.371636.21+/- 56.351754.07+/- 36.061711.76+/- 1.9452.42+/- 0.00
32k1008.22+/- 45.271071.52+/- 26.281131.93+/- 11.521104.42+/- 2.6348.27+/- 0.00
64k680.51+/- 20.97707.44+/- 13.21734.53+/- 3.96726.51+/- 0.4342.41+/- 0.02
128k412.72+/- 7.92420.89+/- 4.67430.91+/- 1.95428.07+/- 0.4534.20+/- 0.01
UD-Q5_K_SQwen3.6-35B-A3B-UD-Q5_K_S02180.93+/- 11.222306.71+/- 3.682469.76+/- 2.622391.10+/- 0.5157.53+/- 0.03
12k1573.98+/- 111.691692.10+/- 62.121801.67+/- 35.111756.96+/- 4.1253.69+/- 0.00
32k1031.18+/- 48.871092.61+/- 26.771153.31+/- 18.771132.36+/- 4.9149.35+/- 0.02
64k690.73+/- 22.51717.11+/- 11.42744.43+/- 4.91735.13+/- 0.5043.30+/- 0.01
128k416.62+/- 8.00423.93+/- 3.61433.71+/- 2.76432.25+/- 0.4234.74+/- 0.00
UD-Q5_K_XLQwen3.6-35B-A3B-UD-Q5_K_XL02056.31+/- 4.762214.86+/- 9.662378.82+/- 1.992309.64+/- 2.1356.63+/- 0.00
12k1511.69+/- 99.921641.12+/- 56.861754.91+/- 32.641707.59+/- 2.5252.97+/- 0.02
32k1005.99+/- 45.871068.15+/- 24.541130.95+/- 15.521102.32+/- 2.4148.75+/- 0.00
64k678.17+/- 21.25706.23+/- 11.88733.59+/- 3.93725.58+/- 0.5542.81+/- 0.01
128k412.27+/- 6.90418.76+/- 3.21430.29+/- 2.56428.56+/- 0.3634.45+/- 0.00
UD-Q6_KQwen3.6-35B-A3B-UD-Q6_K01856.17+/- 2.771989.67+/- 4.892172.87+/- 3.032103.51+/- 12.9055.39+/- 0.01
12k1396.83+/- 88.541515.53+/- 49.131628.92+/- 24.771594.61+/- 0.5151.93+/- 0.01
32k953.62+/- 39.001008.77+/- 22.711068.10+/- 8.911049.05+/- 2.7947.81+/- 0.00
64k655.36+/- 20.98680.96+/- 9.97712.64+/- 3.94704.29+/- 0.8242.11+/- 0.00
128k404.34+/- 7.36411.61+/- 3.70423.25+/- 2.78420.76+/- 0.1533.94+/- 0.01
UD-Q6_K_XLQwen3.6-35B-A3B-UD-Q6_K_XL01875.46+/- 13.232069.30+/- 1.192257.08+/- 1.782197.69+/- 2.5555.58+/- 0.02
12k1420.17+/- 91.641554.50+/- 70.101689.29+/- 31.101648.81+/- 1.2952.11+/- 0.00
32k959.92+/- 42.201039.17+/- 23.461104.73+/- 12.241073.85+/- 3.3247.97+/- 0.03
64k658.08+/- 20.12692.24+/- 10.21722.30+/- 3.09714.14+/- 1.0242.16+/- 0.00
128k405.48+/- 8.29415.62+/- 4.06426.17+/- 2.54424.00+/- 0.4433.99+/- 0.01
UD-Q8_K_XLQwen3.6-35B-A3B-UD-Q8_K_XL01728.02+/- 13.182064.07+/- 12.672248.83+/- 0.372186.63+/- 2.7952.93+/- 0.03
12k1378.17+/- 0.451595.63+/- 3.361709.35+/- 1.741655.85+/- 1.3649.79+/- 0.00
32k940.97+/- 2.491051.67+/- 0.511110.78+/- 4.071094.10+/- 2.1846.03+/- 0.00
64k650.11+/- 0.55699.13+/- 0.46728.24+/- 1.17716.99+/- 0.2040.62+/- 0.00
128k402.01+/- 0.54417.54+/- 0.16426.85+/- 0.94424.89+/- 0.1032.98+/- 0.00
Back to top

Model family

Qwen3.8 27B

1 canonical quantization files

DENSEUB 512
QuantDepthPP512PP1024PP2048PP4096TG128
UD-Q8_K_XLQwen3.8-27B-UD-Q8_K_XL0505.56+/- 0.57493.01+/- 6.10484.69+/- 0.52460.77+/- 4.816.94+/- 0.00
12k365.86+/- 5.26366.98+/- 0.26361.54+/- 2.77348.32+/- 0.266.77+/- 0.00
32k258.37+/- 2.24257.61+/- 0.13255.93+/- 0.12252.18+/- 0.126.54+/- 0.00
64k179.65+/- 1.54179.05+/- 0.75177.29+/- 0.04175.35+/- 0.046.19+/- 0.00
128k107.66+/- 0.48109.13+/- 0.01109.16+/- 0.04108.52+/- 0.005.59+/- 0.00
Back to top

Model family

Qwen3.8 Flash Next

1 canonical quantization files

MOEUB 2048
QuantDepthPP512PP1024PP2048PP4096TG128
UD-IQ4_XSQwen3.8-Flash-Next-UD-IQ4_XS-00001-of-000030715.15+/- 3.99786.62+/- 3.95844.30+/- 15.18804.18+/- 11.0926.86+/- 0.00
12k503.09+/- 39.33567.10+/- 17.99594.54+/- 26.06582.00+/- 2.3822.46+/- 0.07
32k339.19+/- 20.13364.91+/- 7.05385.79+/- 9.65379.18+/- 0.5619.04+/- 0.07
64k218.05+/- 7.82225.79+/- 9.62238.17+/- 2.29234.55+/- 0.6113.54+/- 0.01
128k128.34+/- 3.03130.39+/- 1.18134.56+/- 0.04133.20+/- 0.189.03+/- 0.01
Back to top