2025-09-28 21:58:48 +08:00
|
|
|
|
# Basic Examples
|
2025-09-26 15:47:55 +08:00
|
|
|
|
|
2025-09-28 21:58:48 +08:00
|
|
|
|
Quick-start scripts for experimenting with vLLM-omni.
|
2025-09-26 15:47:55 +08:00
|
|
|
|
|
2025-09-28 21:58:48 +08:00
|
|
|
|
## Scripts
|
2025-09-26 15:47:55 +08:00
|
|
|
|
|
2025-09-28 21:58:48 +08:00
|
|
|
|
- `text_generation.py` – Minimal standalone usage showing how to create an LLM and generate text locally.
|
|
|
|
|
|
- `api_client.py` – Demonstrates calling the FastAPI `/generate` endpoint from Python.
|
2025-09-26 15:47:55 +08:00
|
|
|
|
|
2025-09-28 21:58:48 +08:00
|
|
|
|
Run any script with `python examples/basic/<script>.py`. Ensure the `vllm_omni` conda environment is active and dependencies are installed.
|