This website requires JavaScript.
Explore
Help
Sign In
anodyine
/
vllm-omni
Watch
1
Star
0
Fork
0
Code
Issues
4
Pull Requests
2
Actions
Packages
Projects
Releases
Wiki
Activity
Files
c8b695f1810205805ad11aa2eaef9a75ca7dfe3e
vllm-omni
/
vllm_omni
/
distributed
/
omni_connectors
T
History
tzhouam
8c41492307
Merge remote-tracking branch 'remotes/origin/main' into dev/rebase-v0169
2026-03-06 03:02:50 +00:00
..
connectors
Merge origin/main into dev/vllm-align
2026-03-02 02:10:32 +00:00
transfer_adapter
[Optimize][Qwen3-Omni] Reduce inter-packet latency in async chunk (
#1656
)
2026-03-05 22:26:30 +08:00
utils
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-24 03:23:20 +00:00
__init__.py
[Feature] vLLM-Omni RDMA connector (
#1019
)
2026-02-24 11:13:52 +08:00
adapter.py
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
2026-02-20 08:34:53 +00:00
factory.py
[Feature] vLLM-Omni RDMA connector (
#1019
)
2026-02-24 11:13:52 +08:00
kv_transfer_manager.py
[Feature]: Support cfg kv-cache transfer in multi-stage (
#1422
)
2026-03-02 05:06:28 +00:00