Gao Han
598b4ddb51
[Feature] support multimodal inputs with multiple requests ( #76 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-24 16:02:44 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
Samit
8cafb4294d
[Docs] Setup Documentation System and Re-organize Dependencies ( #49 )
...
Signed-off-by: SamitHuang <285365963@qq.com >
2025-11-15 21:45:43 +08:00
Gao Han
a089dd4c4e
Merge pull request #51 from tzhouam/feat/multi-request-stream-new
...
[Feature] Multi Request Stream for Sync Mode
2025-11-13 10:14:27 +08:00
tzhouam
edae58b137
modify code based on review suggestions
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-11 10:03:26 +08:00
齐保元
d7618b1be4
[fix] support loading model from local path
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
2025-11-09 04:37:19 +08:00
tzhouam
6a7a27801b
Port changes from feat/multi-request-stream (vs main)
2025-11-07 15:48:47 +08:00
Gaohan123
e2b803fbe6
fix a bug
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-05 13:05:12 +08:00
Gaohan123
6e1478222e
Dependency refractored to vLLM v0.11.0
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-04 22:06:41 +08:00
Gaohan123
d4a364f052
fix huggingface download problem for spk_dict.pt
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-01 16:45:34 +08:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
tzhouam
d45f8a6be7
debug typo
2025-10-24 17:47:49 +08:00
tzhouam
61b344dc39
Add import for OmniModelsRegistry in model executor initialization
2025-10-24 17:44:31 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
Gaohan123
22f36de34e
fix error
2025-10-24 16:21:52 +08:00
Gaohan123
eafc7c44c3
fix error for pre-commit
2025-10-24 16:21:50 +08:00
tzhouam
52905a0d17
Enhance Qwen2.5-Omni model by defining TALKER_CODEC_EOS_TOKEN_ID and TALKER_CODEC_BOS_TOKEN_ID constants. Update audio generation logic to use these constants for improved clarity and maintainability. Refactor tensor initialization to utilize the talker's hidden size. Update comments for better understanding and consistency.
2025-10-24 10:02:51 +08:00
tzhouam
a3a77b6cc4
Qwen2.5-Omni: squash 5 commits (add components, refactor, load thinker embedding from weights, remove unused code)
...
Squashed commits:\n- 4e2d812 Add Qwen2.5-Omni model components\n- 351f833 load the thinker embedding from the weights, not rely on local .pt files\n- 2c32533 Refactor Qwen2.5-Omni model files\n- 9163a60 remove unused codes\n- 192bdf8 remove
2025-10-23 14:24:03 +08:00
Gao Han