12 Commits

Include renames

Author	SHA1	Message	Date
Zhou TaichangandCyrus Leung	5f1e41970c	Update vllm_omni/benchmarks/patch/patch.py ... Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>	2026-03-07 13:23:47 +08:00
tzhouam	26744bcb35	Merge origin/main into dev/vllm-align ... Resolved conflicts: - vllm_omni/inputs/preprocess.py: took origin/main's elif mm_processor_kwargs branch, fixed undefined mm_uuids reference - vllm_omni/model_executor/models/qwen3_tts/qwen3_tts_code_predictor_vllm.py: took origin/main's NPU support Made-with: Cursor Signed-off-by: tzhouam <tzhouam@connect.ust.hk>	2026-03-02 02:10:32 +00:00
Ekagra RanjanandHongsheng Liu	aa54569033	Add benchmark for v1/audio/speech non-streaming (#1408) ... Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>	2026-02-27 14:31:52 +08:00
tzhouam	a252918008	[Update] Upgrade vLLM wheel version and enhance metrics handling ... - Updated the vLLM wheel to commit 24650715105a26b41c88f4164777b5e1a0f3200b in Dockerfile.ci. - Modified the `calculate_metrics` function to handle `tokenizer` as optional (can be None) in metrics.py. - Adjusted the `benchmark` function to accept `tokenizer` as optional in patch.py. - Enhanced condition checks in OmniARScheduler to ensure valid token generation in omni_ar_scheduler.py. - Updated input processing to include supported tasks in input_processor.py. - Cleaned up unnecessary code in output_processor.py. - Added support for SSL ciphers in the API server configuration in api_server.py. - Enabled speculative decoding in GPU model runners for improved performance in gpu_generation_model_runner.py and gpu_model_runner.py. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>	2026-02-25 10:02:23 +00:00
tzhouam	bf69cd94bb	Rebase 2026/02/23 ... Update Dockerfile for vllm wheel version and enhance input processing in Omni models. Added decoding for byte messages in async requests, included new metrics in benchmarks, and improved pause state handling in the scheduler. Refined input and output processing methods for better multimodal support and error handling. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>	2026-02-23 03:36:01 +00:00
6 people	75770c9309	[Rebase] Rebase to vllm v0.16.0 (#1357) ... Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk> Signed-off-by: tzhouam <tzhouam@connect.ust.hk> Signed-off-by: princepride <wangzhipeng628@gmail.com> Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Isotr0py <Isotr0py@outlook.com> Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com> Co-authored-by: youkaichao <youkaichao@gmail.com>	2026-02-13 18:05:07 +08:00
Taichang ZhouandCursor	e2ced80d59	Merge origin/main into dev/rebase-v0.16.0. ... Resolve arg_utils merge conflict and align CI base image tag to v0.16.0 for the vLLM rebase track. Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>	2026-02-12 21:18:03 +08:00
John Liu BUAA	f117a07271	[Bugfix] reused metrics to modify the API Server token statistics in Stream Response (#1301) ... Signed-off-by: John Liu BUAA <liukecheng97@gmail.com>	2026-02-12 17:24:01 +08:00
tzhouam	86e20769fd	Add SSL context support in benchmark function for improved connection handling ... Signed-off-by: tzhouam <tzhouam@connect.ust.hk>	2026-02-12 08:52:27 +00:00
wangyuandwangyu31577	117d9bd122	[Bugfix] modify RTF use audio_e2e/audio_duration (#1157) ... Signed-off-by: wangyu31577 <wangyu31577@hundsun.com> Co-authored-by: wangyu31577 <wangyu31577@hundsun.com>	2026-02-04 14:07:46 +08:00
3 people	07f4c3fdd6	[Bugfix] fix benchmark audio timing error and add benchmark test (#1109) ... Signed-off-by: wangyu31577 <wangyu31577@hundsun.com> Co-authored-by: wangyu31577 <wangyu31577@hundsun.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>	2026-01-31 10:15:26 +08:00
3 people	7bfd3c069d	[Benchmark] Add vLLM-Omni Omni model online benchmark (#780) ... Signed-off-by: wangyu31577 <wangyu31577@hundsun.com> Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com> Co-authored-by: wangyu31577 <wangyu31577@hundsun.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>	2026-01-30 11:41:09 +08:00