Commit Graph
8 Commits
Author SHA1 Message Date
Jiangyun Zhu bcc6bd9642 [diffusion] add doc and fix qwen-image (#96)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
2025-11-28 18:07:44 +08:00
Gao Han db81ee9f69 [Docs] optimize and supplement docs system (#86)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
2025-11-28 11:03:52 +08:00
Gao Han c5a89302f1 [Feature] Support online inference (#64)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
2025-11-17 14:44:10 +08:00
Samit 8cafb4294d [Docs] Setup Documentation System and Re-organize Dependencies (#49)
Signed-off-by: SamitHuang <285365963@qq.com>
2025-11-15 21:45:43 +08:00
Gaohan123 a04e945166 add precommit 2025-10-24 16:20:58 +08:00
hsliu 51d2570464 feat: Complete vLLM-omni implementation with conda environment setup
- Add comprehensive PRD, architecture design, and test design documents
- Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations
- Add DiT scheduler and cache manager for diffusion models
- Implement CLI integration with --omni flag support
- Add API server and plugin system for vLLM integration
- Create comprehensive test suite with fixtures
- Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0
- Add conda environment setup and package installation
- Implement stage-based processing architecture
- Add multimodal output processing capabilities

This commit establishes the foundation for multi-modality models
inference and serving with non-autoregressive structures.
2025-09-25 09:10:54 +08:00
hsliu c1da072744 del api md 2025-09-16 16:54:27 +08:00
hsliu 0c5caf6ab1 scheduler api design 2025-09-16 16:05:47 +08:00