tzhouam
3a508d7b7a
rebase: align vllm-omni with vLLM e9163b536e72
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 02:32:39 +00:00
tzhouam
e17fb0e97e
Refactor OpenAI serving components and enhance multimodal handling
...
- Updated import for OpenAIServingEmbedding in api_server.py.
- Enhanced omni_init_app_state to initialize renderer for engine_client.
- Added handle_oov_mm_token parameter to multiple model classes for better multimodal token handling.
- Improved comments for clarity in various model files.
- Adjusted GPUARModelRunner to ensure proper handling of late interaction runner attributes.
Signed-off-by: [Your Name] <[Your Email]>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-13 01:55:17 +00:00
tzhouam
08a2673c66
rebase: align vllm-omni with vLLM 84e436ed1c94
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-11 07:29:52 +00:00
Baoyuan Qi
2fdc647ed7
[BUGFIX] Add compatibility for mimo-audio with vLLM 0.17.0 ( #1752 )
...
Signed-off-by: Baoyuan Qi <qibaoyuan@xiaomi.com >
2026-03-10 20:57:26 +00:00
Baoyuan Qi
32fd084ae2
[MiMo-Audio] Bugfix tp lg than 1 ( #1688 )
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
2026-03-06 14:45:08 +08:00
+13
b19c227fb3
[New Model]: XiaomiMiMo/MiMo-Audio-7B-Instruct support ( #750 )
...
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com >
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
Signed-off-by: hsliu <liuhongsheng4@huawei.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Signed-off-by: GG-li <3226868735@qq.com >
Signed-off-by: Sihao Li <111170255+GG-li@users.noreply.github.com >
Signed-off-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Signed-off-by: mxuax <mxuax@connect.ust.hk >
Signed-off-by: Baoyuan Qi <qibaoyuan@126.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Signed-off-by: wuzhongjian <wuzhongjian_yewu@cmss.chinamobile.com >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
Signed-off-by: baoyuan qi <qibaoyuan@126.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Signed-off-by: Prajwal A <prajwalanagani@gmail.com >
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Signed-off-by: 丁宁 <nndding@gmail.com >
Signed-off-by: SHIJIN ZHANG <75300765+Dovis01@users.noreply.github.com >
Signed-off-by: dingning<dingning7@xiaomi.com >
Signed-off-by: dingning <dingning7@xiaomi.com >
Signed-off-by: dingning <dingning@xiaomi.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: wangyu31577 <wangyu31577@hundsun.com >
Co-authored-by: Zhang Shijin <zhangshijin@xiaomi.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Sihao Li <111170255+GG-li@users.noreply.github.com >
Co-authored-by: XU Mingshi <91017482+mxuax@users.noreply.github.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: JohnJan <wuzhongjian_yewu@cmss.chinamobile.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com >
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com >
Co-authored-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
Co-authored-by: shijin zhang <zsj1364226740@gmail.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: root <root@hk01dgx028.cm.cluster >
Co-authored-by: Prajwal A <34590600+LawJarp-A@users.noreply.github.com >
Co-authored-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
Co-authored-by: dingning <dingning7@xiaomi.com >
Co-authored-by: ning ding <nndding@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-27 11:19:49 +08:00
tzhouam