hsliu
e8b9425bab
- Move vllm_omni/core/omni_llm.py to vllm_omni/entrypoints/omni_llm.py - Update all import statements across the codebase to reflect new location - Fix relative imports within the moved file - Maintain functionality while improving code organization - All imports and functionality tested and working correctly This change better reflects that OmniLLM and AsyncOmniLLM are the main entry points for vLLM-omni functionality, rather than core implementation details.
vLLM-omni Examples
This directory contains examples demonstrating how to use vLLM-omni for multi-modality model inference and serving.
Directory Structure
basic/- Simple usage examples and API clientadvanced/- Advanced features and configurationsmultimodal/- Multi-modality specific examples
Quick Start
-
Basic Usage:
cd examples/basic python simple_usage.py -
API Server:
# Start server vllm serve Qwen/Qwen3-0.6B --omni --port 8000 # Test with client python api_client.py
Examples Overview
Basic Examples (basic/)
simple_usage.py- Direct library usage (sync/async)api_client.py- HTTP API client examplesREADME.md- Basic examples documentation
Advanced Examples (advanced/)
- Multi-stage processing
- Custom configurations
- Performance optimization
Multi-modality Examples (multimodal/)
- Text-to-image generation
- Image-to-text processing
- Multi-modal pipelines
Requirements
- Python 3.8+
- vLLM-omni installed
- For API examples: HTTP server running