cpx1000曙光异构加速卡BW部署qwen3.8-27b 中发帖

国产曙光本地部署qwen3.8-27b
配置:
[image]
启动配置:
#!/bin/sh
# Load model from ModelScope to speed up download
export ASCEND_RT_VISIBLE_DEVICES=0,1
export MODEL_PATH=/root/private_data/SothisAI/model/ExternalSource/Qwen3.8-27B
export VLLM_USE_MODELSCOPE=True
export HCCL_BUFFSIZE=512
export PYTORCH_NPU_ALLOC_CONF=expandable_segments:True
# Size of the shared buffer (in MB) used by HCCL for NPU-to-NPU collec...