del reamds

This commit is contained in:
hsliu committed 2025-09-29 17:53:03 +08:00
1 parent c330e5e8f3
commit 772583140f
2 files changed
-26

No files matched your search

-16
View File
@@ -1,16 +0,0 @@
# vLLM-omni Examples
A curated set of runnable samples demonstrating vLLM-omni usage.
## Directory Overview
- **basic/** – Quick-start scripts for text-only flows.
- `text_generation.py` – Minimal CPU-friendly text generation with vLLM.
- `api_client.py` – Calls the FastAPI server using the JSON API.
- `docker_run.py` – Template for launching the server in Docker.
- **omni/** – Multi-stage AR → DiT pipelines powered by diffusers.
- `ar_dit_diffusers.py` – Runs Qwen3 (AR) feeding Stable Diffusion 2.1 (DiT).
- `configs/ar_dit_local.yaml` – Sample plugin config referencing local weights.
- **advanced/** – Placeholder for upcoming complex flows (Ray, benchmarking).
See the subdirectory READMEs for usage instructions.
-10
View File
@@ -1,10 +0,0 @@
# Basic Examples
Quick-start scripts for experimenting with vLLM-omni.
## Scripts
- `text_generation.py` – Minimal standalone usage showing how to create an LLM and generate text locally.
- `api_client.py` – Demonstrates calling the FastAPI `/generate` endpoint from Python.
Run any script with `python examples/basic/<script>.py`. Ensure the `vllm_omni` conda environment is active and dependencies are installed.