Gao Han
db81ee9f69
[Docs] optimize and supplement docs system ( #86 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-28 11:03:52 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
tzhouam
bc69d8e931
rename util further rename imports
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-11 10:57:15 +08:00
tzhouam
edae58b137
modify code based on review suggestions
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-11 10:03:26 +08:00
tzhouam
c83d223e91
Squash 7 commits: 36ada0478a 0ef1fefd45 519c140d20 c18fc40f10 5f3f53a39d da385277a2 edefcc244b
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-10 16:42:58 +08:00
tzhouam
8e8783d78a
Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.
2025-11-10 11:58:47 +08:00
Gaohan123
6e1478222e
Dependency refractored to vLLM v0.11.0
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-04 22:06:41 +08:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
tzhouam
3b1324ea39
Merge branch 'main' into end2end_fixup
2025-10-24 17:41:03 +08:00
tzhouam
3265e857eb
Refactor OmniLLM and MultimodalOutputProcessor initialization
...
- Removed AsyncOmniLLM from the main entry points as it is not supported yet.
- Updated the constructor of MultimodalOutputProcessor to set a default value for engine_core_output_type.
- Adjusted output type handling in various methods to utilize the new default engine_core_output_type for consistency.
2025-10-24 17:15:34 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
Gaohan123
61a215fb54
fix file name
2025-10-24 10:19:35 +08:00
Gaohan123
2c08c04730
fix for reviews of copilot
2025-10-24 10:17:22 +08:00
Gaohan123
98a85d42a6
fix for some reviews
2025-10-23 10:26:21 +08:00
Gaohan123
87d6414a26
supplement some imports
2025-10-22 18:14:11 +08:00
Gaohan123
6111c288d0
fix some reviews from gemini
2025-10-22 17:46:10 +08:00
Gaohan123
20cfd15cc6
Add entrypoint class and stage management
2025-10-22 14:37:55 +08:00
hsliu
c330e5e8f3
del unnessearcy files
2025-09-29 17:49:32 +08:00
hsliu
81f04d3cf9
update ar_dit_test
2025-09-28 21:58:48 +08:00
hsliu
e8b9425bab
refactor: move omni_llm.py to entrypoints directory
...
- Move vllm_omni/core/omni_llm.py to vllm_omni/entrypoints/omni_llm.py
- Update all import statements across the codebase to reflect new location
- Fix relative imports within the moved file
- Maintain functionality while improving code organization
- All imports and functionality tested and working correctly
This change better reflects that OmniLLM and AsyncOmniLLM are the main entry points
for vLLM-omni functionality, rather than core implementation details.
2025-09-26 17:39:00 +08:00
Gao Han