Gao Han
db81ee9f69
[Docs] optimize and supplement docs system ( #86 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-28 11:03:52 +08:00
Gao Han
598b4ddb51
[Feature] support multimodal inputs with multiple requests ( #76 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-24 16:02:44 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
Baoyuan Qi
bf82e18374
[fix] adapt hidden state device for multi-hardware support ( #61 )
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
2025-11-16 17:31:04 +08:00
Samit
8cafb4294d
[Docs] Setup Documentation System and Re-organize Dependencies ( #49 )
...
Signed-off-by: SamitHuang <285365963@qq.com >
2025-11-15 21:45:43 +08:00
Gao Han
a089dd4c4e
Merge pull request #51 from tzhouam/feat/multi-request-stream-new
...
[Feature] Multi Request Stream for Sync Mode
2025-11-13 10:14:27 +08:00
tzhouam
edae58b137
modify code based on review suggestions
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-11 10:03:26 +08:00
齐保元
d7618b1be4
[fix] support loading model from local path
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
2025-11-09 04:37:19 +08:00
tzhouam
6a7a27801b
Port changes from feat/multi-request-stream (vs main)
2025-11-07 15:48:47 +08:00
Gaohan123
e2b803fbe6
fix a bug
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-05 13:05:12 +08:00
Gaohan123
6e1478222e
Dependency refractored to vLLM v0.11.0
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-04 22:06:41 +08:00
Gaohan123
d4a364f052
fix huggingface download problem for spk_dict.pt
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-01 16:45:34 +08:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
tzhouam
d45f8a6be7
debug typo
2025-10-24 17:47:49 +08:00
tzhouam
61b344dc39
Add import for OmniModelsRegistry in model executor initialization
2025-10-24 17:44:31 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
Gaohan123
22f36de34e
fix error
2025-10-24 16:21:52 +08:00
Gaohan123
eafc7c44c3
fix error for pre-commit
2025-10-24 16:21:50 +08:00
Hongsheng Liu
15dbe97750
Merge pull request #13 from Gaohan123/entrypoint_stage
...
[Engine] Add entrypoint class and stage management
2025-10-24 10:38:16 +08:00
Gaohan123
2c08c04730
fix for reviews of copilot
2025-10-24 10:17:22 +08:00
tzhouam
ae3b7504b2
Merge branch 'feat/qwen_2_5_omni_models' of https://github.com/tzhouam/vllm-omni into feat/qwen_2_5_omni_models
2025-10-24 10:02:58 +08:00
tzhouam
52905a0d17
Enhance Qwen2.5-Omni model by defining TALKER_CODEC_EOS_TOKEN_ID and TALKER_CODEC_BOS_TOKEN_ID constants. Update audio generation logic to use these constants for improved clarity and maintainability. Refactor tensor initialization to utilize the talker's hidden size. Update comments for better understanding and consistency.
2025-10-24 10:02:51 +08:00
Zhou Taichang and Copilot
8a6e298243
Apply suggestion from @Copilot
...
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
2025-10-24 09:43:45 +08:00
tzhouam
a3a77b6cc4
Qwen2.5-Omni: squash 5 commits (add components, refactor, load thinker embedding from weights, remove unused code)
...
Squashed commits:\n- 4e2d812 Add Qwen2.5-Omni model components\n- 351f833 load the thinker embedding from the weights, not rely on local .pt files\n- 2c32533 Refactor Qwen2.5-Omni model files\n- 9163a60 remove unused codes\n- 192bdf8 remove
2025-10-23 14:24:03 +08:00
Gaohan123
98a85d42a6
fix for some reviews
2025-10-23 10:26:21 +08:00
Gaohan123
87d6414a26
supplement some imports
2025-10-22 18:14:11 +08:00
Gaohan123
20cfd15cc6
Add entrypoint class and stage management
2025-10-22 14:37:55 +08:00
hsliu
81f04d3cf9
update ar_dit_test
2025-09-28 21:58:48 +08:00
Gao Han