Files
vllm-omni/tests
tzhouamandClaude Fable 5.1 1baabdc78b [edge-infer] M0 serving end-to-end test: the OpenAI server on the local text plan
Drives `vllm-omni serve <model> --omni` as a subprocess through the
online-serving launcher and checks /health, /v1/models, non-streaming
and streaming chat completions, and that a client disconnect mid-stream
leaves the server answering. Sets VLLM_USE_FLASHINFER_SAMPLER=0 like
LocalTextEngine does: the flashinfer sampler JITs with nvcc at runtime,
which a venv without a CUDA toolkit does not have (measured: the WSL
reference venv died in profile_run with 'Could not find nvcc').

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-18 18:17:16 +08:00
..