This website requires JavaScript.
Explore
Help
Sign In
anodyine
/
vllm-omni
Watch
1
Star
0
Fork
0
Code
Issues
4
Pull Requests
2
Actions
Packages
Projects
Releases
Wiki
Activity
Files
a6da4691347b6c044ed388043a5febefca7e5c4e
vllm-omni
/
docs
/
user_guide
/
quantization
T
History
Isotr0py
b95905deb1
[Quantization] Migrate GGUF diffusion model support to OOT plugin (
#4769
)
...
Signed-off-by: Isotr0py <
mozf@mail2.sysu.edu.cn
> Signed-off-by: Isotr0py <
Isotr0py@outlook.com
>
2026-07-11 18:48:43 +00:00
..
autoround.md
[AutoRound] Support GLM-Image W4A16 quantization model (
#3059
)
2026-05-28 07:19:06 +00:00
fp8.md
[Bugfix][Quant] Gate quack FP8 to datacenter Blackwell (sm_100.x) only (
#4817
)
2026-07-01 16:51:17 +00:00
gguf.md
[Quantization] Migrate GGUF diffusion model support to OOT plugin (
#4769
)
2026-07-11 18:48:43 +00:00
int8.md
[Docs] Update diffusion quantization guides (
#3200
)
2026-04-28 04:33:24 -07:00
modelopt.md
[Quantization][Qwen3-Omni] Enable NVFP4 W4A4 serving on Blackwell (
#4025
)
2026-06-18 10:01:46 +08:00
msmodelslim.md
[Docs] Update diffusion quantization guides (
#3200
)
2026-04-28 04:33:24 -07:00
mxfp4.md
[ROCm][Perf] Add ROCm support for MXFP4 (w4a4) online quantization (
#4104
)
2026-07-03 13:17:32 +08:00
mxfp8.md
[MXFP8][XPU] enable mxfp8 using vLLM main repo method (
#3782
)
2026-05-28 02:47:22 +00:00
online.md
[MXFP8][XPU] enable mxfp8 using vLLM main repo method (
#3782
)
2026-05-28 02:47:22 +00:00
overview.md
[ROCm][Perf] Add ROCm support for MXFP4 (w4a4) online quantization (
#4104
)
2026-07-03 13:17:32 +08:00
quantized_kvcache.md
[BugFix] fix(omni): isolate diffusion KV-cache dtype from vLLM --kv-cache-dtype
#3585
(
#3596
)
2026-05-15 11:22:59 +08:00