1 parent
959b3ca8c8
commit
ab657ce374
8 files changed
+8
-7
No files matched your search
@@ -1,4 +1,4 @@
|
||||
# LoRA Inference Examples
|
||||
# LoRA Inference(Diffusion)
|
||||
|
||||
This directory contains examples for using LoRA (Low-Rank Adaptation) adapters with vLLM-omni diffusion models for offline inference.
|
||||
The example uses the `stabilityai/stable-diffusion-3.5-medium` as the default model, but you can replace it with other models in vLLM-omni.
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
# Qwen3-TTS Offline Inference
|
||||
# Qwen3-TTS
|
||||
|
||||
This directory contains an offline demo for running Qwen3 TTS models with vLLM Omni. It builds task-specific inputs and generates WAV files locally.
|
||||
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
# Online LoRA Inference (Diffusion)
|
||||
# LoRA Inference(Diffusion)
|
||||
|
||||
This example shows how to use **per-request LoRA** with vLLM-Omni diffusion models via the OpenAI-compatible Chat Completions API.
|
||||
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
# Qwen3-TTS Online Serving
|
||||
# Qwen3-TTS
|
||||
|
||||
This directory contains examples for running Qwen3-TTS models with vLLM-Omni's online serving API.
|
||||
|
||||
|
||||
Reference in new issue
Block a user