Qwen

/

Qwen3-Next-80B-A3B-Instruct-FP8

like 59

Follow

Qwen 57.9k

Hello. I try to launch the model on H100 using sglang. sglang version: 0.5.3rc0. The following error happens when it tries to load the model:

  File "/home/mkim/miniconda3/envs/dataprep/lib/python3.11/site-packages/sglang/srt/models/qwen3_next.py", line 1025, in load_weights
    param = params_dict[name]
            ~~~~~~~~~~~^^^^^^
KeyError: 'model.layers.44.linear_attn.in_proj_qkvz.weight_scale_inv'

I've tried to install latest sglang version using the command you recommend: pip install 'sglang[all] @ git+https://github.com/sgl-project/sglang.git@main', but it doesn't work:

Collecting sglang@ git+https://github.com/sgl-project/sglang.git@main (from sglang[all]@ git+https://github.com/sgl-project/sglang.git@main)
  Cloning https://github.com/sgl-project/sglang.git (to revision main) to /tmp/pip-install-v6k3_lca/sglang_b57f0918d5ce48a6a9f914d982c79e6e
  Running command git clone --filter=blob:none --quiet https://github.com/sgl-project/sglang.git /tmp/pip-install-v6k3_lca/sglang_b57f0918d5ce48a6a9f914d982c79e6e
  Resolved https://github.com/sgl-project/sglang.git to commit 4726c9197ffd5ff95e0c7be7175d1c2dae73c4ed
ERROR: sglang@ git+https://github.com/sgl-project/sglang.git@main from git+https://github.com/sgl-project/sglang.git@main (from sglang[all]@ git+https://github.com/sgl-project/sglang.git@main) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.```