From 2f97db17a3bb6ca51c2b20030f5b88456803a46a Mon Sep 17 00:00:00 2001 From: SYLAR <125541396+lishunyang12@users.noreply.github.com> Date: Sun, 8 Feb 2026 07:10:49 +0800 Subject: [PATCH] [Doc] Update QA relevant to quantization (#1257) Signed-off-by: lishunyang --- docs/usage/faq.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/usage/faq.md b/docs/usage/faq.md index e109439e8..c080eae40 100644 --- a/docs/usage/faq.md +++ b/docs/usage/faq.md @@ -22,7 +22,7 @@ A: At first, you can check current [issues](https://github.com/vllm-project/vllm > Q: Does vLLM-Omni support AWQ or any other quantization? -A: vLLM-Omni partitions model into several stages. For AR stages, it will reuse main logic of LLMEngine in vLLM. So current quantization supported in vLLM should be also supported in vLLM-Omni for them. But systematic verification is ongoing. For quantization for DiffusionEngine, we are working on it. Please stay tuned and welcome contribution! +A: We plan to introduce GGUF FP8 prequantized models and online FP8 quantization in version 0.16.0. Support for other quantization types will follow in future releases. For details, please see our [Q1 quantization roadmap](https://github.com/vllm-project/vllm-omni/issues/1057). > Q: Does vLLM-Omni support multimodal streaming input and output?