yolovino (@yol1) 在 qwen3.8-flash 24GB显存 本地部署教程及测试 中发帖
推理引擎strata
[image]
[image]
部署教程如下
download file and Extract
conda create -n strata-build -c conda-forge python=3.12 cmake ninja -y
conda activate strata-build
cd ~/Strata-main
./setup.sh
根据本地硬件实际情况选择,我这里全拉满
[image]
追求质量选择原版+4(ipq3_s)
[image]
选择64k
[image]
复杂推理选8bit
如遇代理问题可手动下载
Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00001-of-00002.gguf
Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S-00002...