This website requires JavaScript.
Explore
Help
Sign In
anodyine
/
vllm-omni
Watch
1
Star
0
Fork
0
Code
Issues
4
Pull Requests
2
Actions
Packages
Projects
Releases
Wiki
Activity
Files
e6d4cdd71a46ab97f5682d0cff6cd3e76db73400
vllm-omni
/
vllm_omni
/
distributed
/
omni_connectors
T
History
tzhouam
e6d4cdd71a
Refactor model mode initialization and enhance error handling in AsyncOmni. Update worker type retrieval in omni_stage and add audio token handling in Qwen3OmniMoe classes for improved robustness.
...
Signed-off-by: tzhouam <
tzhouam@connect.ust.hk
>
2026-03-09 06:17:08 +00:00
..
connectors
Merge origin/main into dev/vllm-align
2026-03-02 02:10:32 +00:00
transfer_adapter
Refactor model mode initialization and enhance error handling in AsyncOmni. Update worker type retrieval in omni_stage and add audio token handling in Qwen3OmniMoe classes for improved robustness.
2026-03-09 06:17:08 +00:00
utils
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-24 03:23:20 +00:00
__init__.py
[Feature] vLLM-Omni RDMA connector (
#1019
)
2026-02-24 11:13:52 +08:00
adapter.py
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
2026-02-20 08:34:53 +00:00
factory.py
[Feature] vLLM-Omni RDMA connector (
#1019
)
2026-02-24 11:13:52 +08:00
kv_transfer_manager.py
[Feature]: Support cfg kv-cache transfer in multi-stage (
#1422
)
2026-03-02 05:06:28 +00:00