Files
vllm-omni/examples/basic/README.md
T

10 lines
423 B
Markdown
Raw Normal View History

2025-09-28 21:58:48 +08:00
# Basic Examples
2025-09-28 21:58:48 +08:00
Quick-start scripts for experimenting with vLLM-omni.
2025-09-28 21:58:48 +08:00
## Scripts
2025-09-28 21:58:48 +08:00
- `text_generation.py` – Minimal standalone usage showing how to create an LLM and generate text locally.
- `api_client.py` – Demonstrates calling the FastAPI `/generate` endpoint from Python.
2025-09-28 21:58:48 +08:00
Run any script with `python examples/basic/<script>.py`. Ensure the `vllm_omni` conda environment is active and dependencies are installed.