vllm-omni

105 Commits 235 Branches 31 Tags

3 Commits

Include renames

Author	SHA1	Message	Date
Gaohan123	171f3c1ea7	fix conflicts	2025-10-24 16:49:19 +08:00
Zhou TaichangandCopilot	9ebc1dd652	Apply suggestion from @Copilot Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>	2025-10-24 10:41:54 +08:00
tzhouam	19220aae82	Add scheduling components for vLLM-omni - Introduced `DiffusionScheduler` to handle scheduling for diffusion models, allowing immediate request completion. - Added `OmniNewRequestData` to encapsulate additional request data, including prompt embeddings and extra information. - Updated `OmniScheduler` to ensure compatibility with new request data structures. - Created `output.py` to define new data classes for enriched request handling. - Enhanced `__init__.py` in the engine module to support new payload structures for prompt embeddings and additional information.	2025-10-22 15:05:23 +08:00

Author

SHA1

Message

Date

Gaohan123

171f3c1ea7

fix conflicts

2025-10-24 16:49:19 +08:00

Zhou TaichangandCopilot

9ebc1dd652

Apply suggestion from @Copilot

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>

2025-10-24 10:41:54 +08:00

tzhouam

19220aae82

Add scheduling components for vLLM-omni

- Introduced `DiffusionScheduler` to handle scheduling for diffusion models, allowing immediate request completion.
- Added `OmniNewRequestData` to encapsulate additional request data, including prompt embeddings and extra information.
- Updated `OmniScheduler` to ensure compatibility with new request data structures.
- Created `output.py` to define new data classes for enriched request handling.
- Enhanced `__init__.py` in the engine module to support new payload structures for prompt embeddings and additional information.

2025-10-22 15:05:23 +08:00