yolovino (@yol1) 在 qwen3.8-flash 24GB显存 本地部署教程及测试 中发帖

推理引擎strata 
[image]
[image]
部署教程如下
download file and Extract
conda create -n strata-build -c conda-forge python=3.12 cmake ninja -y
conda activate strata-build

cd ~/Strata-main
./setup.sh


根据本地硬件实际情况选择,我这里全拉满

[image]

追求质量选择原版+4(ipq3_s)

[image]

选择64k

[image]

复杂推理选8bit


如遇代理问题可手动下载

Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00001-of-00002.gguf
Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00002...