Logo
Explore Help
Sign In
anodyine/vllm-omni
Watch 1
Star 0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
8efd9d832d4e41773ed6247929c81d125025495f
vllm-omni/docs/user_guide/quantization
T
History
Yihong Jin 2f64c712fd [Quantization][Qwen3-Omni] Enable NVFP4 W4A4 serving on Blackwell (#4025)
Signed-off-by: Yihong Jin <yihongjin404@gmail.com>
2026-06-18 10:01:46 +08:00
..
autoround.md
[AutoRound] Support GLM-Image W4A16 quantization model (#3059)
2026-05-28 07:19:06 +00:00
fp8.md
[Doc] validate Cosmos3-Nano online FP8 (#4393)
2026-06-15 03:36:19 +00:00
gguf.md
[Rebase] Rebase to vllm releases/v0.22.0 (#3891)
2026-06-01 11:08:12 +08:00
int8.md
[Docs] Update diffusion quantization guides (#3200)
2026-04-28 04:33:24 -07:00
modelopt.md
[Quantization][Qwen3-Omni] Enable NVFP4 W4A4 serving on Blackwell (#4025)
2026-06-18 10:01:46 +08:00
msmodelslim.md
[Docs] Update diffusion quantization guides (#3200)
2026-04-28 04:33:24 -07:00
mxfp4.md
[AutoRound] Support WAN2.2 W4A16 quantization model (#3353)
2026-05-21 17:54:41 +08:00
mxfp8.md
[MXFP8][XPU] enable mxfp8 using vLLM main repo method (#3782)
2026-05-28 02:47:22 +00:00
online.md
[MXFP8][XPU] enable mxfp8 using vLLM main repo method (#3782)
2026-05-28 02:47:22 +00:00
overview.md
[NPU][Quant] Add W4A4 MXFP4 online & MXFP4 dual-scale online/offline quantization support for Wan2.2 T2V / I2V inference on Ascend NPU (#3578)
2026-05-20 06:21:29 +00:00
quantized_kvcache.md
[BugFix] fix(omni): isolate diffusion KV-cache dtype from vLLM --kv-cache-dtype #3585 (#3596)
2026-05-15 11:22:59 +08:00
Powered by Gitea Version: 28.1.0 Page: 35ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API