anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Feature] Support online inference (#64)

Browse Source 
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
This commit is contained in:
Gao Han authored and GitHub committed 2025-11-17 14:44:10 +08:00
1 parent bf82e18374
commit c5a89302f1
52 files changed
+3666 -685
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/contributing/design_documents/api_design_doc.md
+1 -1
View File
@@ -2,7 +2,7 @@
This document contains comprehensive API design documentation for all core modules in vLLM-omni. These templates provide a standardized structure for designing and implementing the core, engine, executor, and worker modules.
## 📋 Module API
## 📋 Module API
### Core Module API
**Core module** provides fundamental scheduling, caching, and resource management functionality.