hsliu
51d2570464
- Add comprehensive PRD, architecture design, and test design documents - Implement core modules: OmniLLM, AsyncOmniLLM, stage configurations - Add DiT scheduler and cache manager for diffusion models - Implement CLI integration with --omni flag support - Add API server and plugin system for vLLM integration - Create comprehensive test suite with fixtures - Update dependencies to vLLM 0.10.2 and PyTorch 2.8.0 - Add conda environment setup and package installation - Implement stage-based processing architecture - Add multimodal output processing capabilities This commit establishes the foundation for multi-modality models inference and serving with non-autoregressive structures.
27 lines
400 B
Plaintext
27 lines
400 B
Plaintext
# Core dependencies
|
|
vllm>=0.10.2
|
|
torch>=2.7
|
|
transformers>=4.30.0
|
|
numpy>=1.21.0
|
|
pillow>=8.0.0
|
|
opencv-python>=4.5.0
|
|
|
|
# API and serving
|
|
fastapi>=0.100.0
|
|
uvicorn>=0.20.0
|
|
pydantic>=2.0.0
|
|
gradio>=3.0.0
|
|
|
|
# Async and distributed computing
|
|
asyncio-mqtt>=0.11.0
|
|
ray>=2.0.0
|
|
|
|
# Development dependencies
|
|
pytest>=7.0.0
|
|
pytest-asyncio>=0.21.0
|
|
pytest-cov>=4.0.0
|
|
black>=23.0.0
|
|
isort>=5.12.0
|
|
flake8>=6.0.0
|
|
mypy>=1.0.0
|