Gao Han
02b1b36c6d
[Bugfix] Fix ci bug for qwen2.5-omni ( #230 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2025-12-08 02:43:48 +08:00
Gao Han
d53155f45c
[Bugfix] Fix the curl bug of qwen3-omni and doc errors ( #135 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-12-01 08:01:54 +00:00
Alicia
3427fb4774
[Feat] Rename AsyncOmniLLM -> AsyncOmni ( #103 )
...
Signed-off-by: WANG Cong <115451386+congw729@users.noreply.github.com >
2025-11-30 22:26:33 +08:00
Gao Han
bfd3cad5ee
[Bugfix] Fix bug of online serving for qwen2.5-omni ( #118 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-30 21:30:17 +08:00
Canlin Guo
ec9e04027d
[Feat] Add NPU Backend support for vLLM-Omni ( #89 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2025-11-30 20:39:06 +08:00
Gao Han
88c00fb271
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs ( #113 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-30 18:20:44 +08:00
Roger Wang and Gao Han
a5800cd2c2
[Doc] Misc documentation polishing ( #98 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
Signed-off-by: Gao Han <gaohan19@huawei.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2025-11-29 20:42:39 +08:00
Jiangyun Zhu
bcc6bd9642
[diffusion] add doc and fix qwen-image ( #96 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-28 18:07:44 +08:00
Gao Han
db81ee9f69
[Docs] optimize and supplement docs system ( #86 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-28 11:03:52 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
Samit
8cafb4294d
[Docs] Setup Documentation System and Re-organize Dependencies ( #49 )
...
Signed-off-by: SamitHuang <285365963@qq.com >
2025-11-15 21:45:43 +08:00
Gaohan123
a04e945166
add precommit
2025-10-24 16:20:58 +08:00
hsliu
51d2570464
feat: Complete vLLM-omni implementation with conda environment setup
...
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities
This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
2025-09-25 09:10:54 +08:00
hsliu
c1da072744
del api md
2025-09-16 16:54:27 +08:00
hsliu
0c5caf6ab1
scheduler api design
2025-09-16 16:05:47 +08:00
Gao Han