tzhouam d7cfe195ea [Enhancement] Refactor OmniARScheduler and OmniGenerationScheduler to include OmniSchedulerOutput ...

- Updated OmniARScheduler to wrap output in OmniSchedulerOutput, including transfer metadata for finished requests needing KV cache transfer.
- Enhanced OmniGenerationScheduler to handle routed experts and finish reasons more effectively, ensuring proper output structure.
- Introduced performance statistics handling in both schedulers for improved monitoring.

Signed-off-by: [Your Name] <your.email@example.com>

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-01-28 15:40:59 +08:00

..

sched

[Enhancement] Refactor OmniARScheduler and OmniGenerationScheduler to include OmniSchedulerOutput

2026-01-28 15:40:59 +08:00

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00