vllm-omni

anodyine/vllm-omni

0 Fork 0

Files

T

History

b41e6707b1 [Bugfix][MammothModa2] Stop allocating AR KV cache for the replaced language model (#8095 )

Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: zijianc2 <157244773+zijianc2@users.noreply.github.com>
Co-authored-by: hsliuustc0106 <222337142+hsliuustc0106@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-09-25 21:28:59 +08:00

layers

Add NPU support for OmniMRotaryEmbedding (#3609 )

2026-06-18 16:58:40 +08:00

model_loader

Add vLLM-Omni library info to Hugging Face Hub requests (#5381 )

2026-09-08 10:08:38 -06:00

models

[Bugfix][MammothModa2] Stop allocating AR KV cache for the replaced language model (#8095 )

2026-09-25 21:28:59 +08:00

stage_input_processors

[Bugfix] Read hidden layer key from model config instead of hardcoding 24 (#5825 )