tzhouam
723c550209
Integrate portable edge graph backends with Omni runtime
...
Extract versioned stage contracts, model shared CPU/iGPU/NPU memory constraints, and add explicit graph routes, reservations, output acknowledgements, and worker retirement. Fix native Windows shared-buffer lifetime and host paths. Document qualified hardware paths and remaining rollout gates.
2026-09-22 13:12:33 +08:00
Chenguang Zheng
087ac46318
[Refactor 1/N] Centralize Omni config resolution ( #5140 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
2026-09-08 10:30:26 +08:00
amy-why-3459
3c6648d8a5
[Bugfix][NPU] Break the pytest DiffusionOutput circular import ( #6293 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-08-18 10:11:10 +08:00
8ddcb3621f
[Config] Add structured VllmOmniConfig classes ( #4425 )
...
Signed-off-by: Acerak01-fy <wfy2003324@163.com >
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Signed-off-by: Wang fuyin <wfy2003324@163.com >
Co-authored-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-25 17:48:20 +08:00
Alex Brooks
465f1464d2
[Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager ( #3760 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-24 11:02:29 +08:00
b8f68174ad
[Refactor] Remove dead legacy pipeline.yaml loader and duplicate diff… ( #4023 )
...
Signed-off-by: dph97 <nenbaying@163.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
Co-authored-by: zhuhonghan <z00806815@china.huawei.com >
2026-06-09 07:34:35 +08:00
a3903810fe
[Config Refactor][2/N] Pipeline + Deploy Config Schema ( #2383 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: reidliu41 <reid201711@gmail.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: reidliu41 <reid201711@gmail.com >
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-19 14:36:00 +12:00
SYLAR
c8c60e1970
[Config Refactor][1/2] Model Pipeline Configuration System ( #1115 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
2026-03-12 21:09:34 +08:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
Roger Wang and Gao Han
a5800cd2c2
[Doc] Misc documentation polishing ( #98 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
Signed-off-by: Gao Han <gaohan19@huawei.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2025-11-29 20:42:39 +08:00
Gaohan123
6e1478222e
Dependency refractored to vLLM v0.11.0
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-04 22:06:41 +08:00
Gaohan123
6cf73c4e80
Remove unused files and fix some bugs
2025-10-25 18:02:11 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
Gaohan123
a04e945166
add precommit
2025-10-24 16:20:58 +08:00
Gaohan123
98a85d42a6
fix for some reviews
2025-10-23 10:26:21 +08:00
Gaohan123
20cfd15cc6
Add entrypoint class and stage management
2025-10-22 14:37:55 +08:00
hsliu
51d2570464
feat: Complete vLLM-omni implementation with conda environment setup
...
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities
This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
2025-09-25 09:10:54 +08:00
hsliu
dcb8868477
update config and entrypoints
2025-09-11 16:15:48 +08:00
hsliu
154d9ca4ff
Initial vLLM-omni repository structure
...
- Add complete directory structure for multimodal and non-autoregressive processing
- Include AsyncLLM, OmniEngine, and DiffusionEngine modules
- Add processors, schedulers, executors, and output processors
- Add API interfaces for Higress, Gradio, and ComfyUI
- Add configuration management and CLI interface
- Add comprehensive test structure and documentation
- Add pyproject.toml with dependencies and project configuration
- Add examples and documentation structure
2025-09-11 14:32:51 +08:00
tzhouam