This website requires JavaScript.
Explore
Help
Sign In
anodyine
/
vllm-omni
Watch
1
Star
0
Fork
0
Code
Issues
4
Pull Requests
2
Actions
Packages
Projects
Releases
Wiki
Activity
Files
9869ea007ea08e431ba78bcb85b8f41b8d805097
vllm-omni
/
vllm_omni
/
distributed
/
omni_connectors
T
History
tzhouam
9869ea007e
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
...
Signed-off-by: tzhouam <
tzhouam@connect.ust.hk
>
2026-02-20 08:34:53 +00:00
..
connectors
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
2026-02-20 08:34:53 +00:00
transfer_adapter
[Feature]async scheduling to overlap chunk IO and compute (
#951
)
2026-02-12 16:05:02 +08:00
utils
[Feature] Implement YuanrongConnector based on OmniConnectorBase (
#716
)
2026-01-27 20:17:02 +08:00
__init__.py
[Feature] Implement YuanrongConnector based on OmniConnectorBase (
#716
)
2026-01-27 20:17:02 +08:00
adapter.py
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
2026-02-20 08:34:53 +00:00
factory.py
[Feature] Implement YuanrongConnector based on OmniConnectorBase (
#716
)
2026-01-27 20:17:02 +08:00
kv_transfer_manager.py
[Core]: KV Cache Transfer Encapsulation (
#979
)
2026-01-28 23:12:45 +08:00