vllm-omni

audex_s2s_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audex_s2s.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audex_thinker_only_30b.yaml

[New Model] support nemotron Audex (#4976 )

2026-07-28 03:58:22 +00:00

audex_thinker_only.yaml

[New Model] support nemotron Audex (#4976 )

2026-07-28 03:58:22 +00:00

audex_tta_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audex_tta.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audex_tts_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audex_tts.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

audio8_tts.yaml

[Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157 )

2026-09-08 19:00:25 -07:00

auk.yaml

[Model] Add Tencent AuK speech generation and editing (encoder + diffusion pipeline) (#7385 )

2026-09-11 20:09:58 +00:00

aura_omni.yaml

[Model] Integrate AURA into Full-Duplex Runtime (#7633 )

2026-09-21 09:26:54 -07:00

bagel_single_stage.yaml

[Docs] Remove stale stage config references (#6270 )

2026-08-20 07:09:12 +08:00

bagel_think.yaml

[Config Refactor]: Remove bagel yaml (#2936 )

2026-04-24 21:21:30 +08:00

bagel.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

breeze_tts_2_throughput.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

breeze_tts_2.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

breeze_tts_throughput.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

breeze_tts.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752 )

2026-09-22 17:10:15 -07:00

cosmos3_policy_droid.yaml

Cosmos3 action policy improvements (#6460 )

2026-09-10 22:32:50 +08:00

cosyvoice3.yaml

[Bugfix][CosyVoice3] Resolve hash snapshot pipeline (#6896 )

2026-09-08 20:33:38 -07:00

covo_audio.yaml

[New Model] Add support for tencent/Covo-Audio-Chat (#2293 )

2026-05-12 14:39:58 +08:00

dreamzero_tp1_cfg2.yaml

[Bugfix] Select the AR-Diffusion engine in the DreamZero CFG-parallel deploy config (#5439 )

2026-07-28 17:14:26 +08:00

dreamzero.yaml

[BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366 ) (#4534 )

2026-07-05 07:17:58 +08:00

fish_qwen3_omni_2gpu.yaml

[Docs] Remove stale stage config references (#6270 )

2026-08-20 07:09:12 +08:00

fish_qwen3_omni_high_concurrency_dual_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

fish_qwen3_omni_high_concurrency_single_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

fish_qwen3_omni.yaml

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546 )

2026-09-16 11:38:06 -07:00

gepard.yaml

[Model] Add Gepard-1.0 native-AR FSQ/NanoCodec TTS (offline inference) (#5666 )

2026-08-14 22:06:05 -07:00

glm_image.yaml

glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config (#3235 )

2026-05-27 12:18:47 +12:00

glm_tts.yaml

[Model] Add GLM-TTS text-to-speech model support (#3141 )

2026-05-24 05:42:26 +08:00

Gr00tN1d7.yaml

[Diffusion] add GR00T-N1.7 pipeline with OpenPI serving (#3798 )

2026-06-20 11:45:26 +08:00

higgs_audio_v2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

higgs_multimodal_qwen3_high_throughput.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068 )

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3_low_latency.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068 )

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3.yaml

[BugFix][Higgs-Audio-V3] Fix transcript and concurrent sampling tests (#6422 )

2026-08-30 08:52:15 +00:00

hunyuan_image3_ar.yaml

[Config] Add HunyuanImage3 deploy configs (#3172 )

2026-05-11 22:49:19 +08:00

hunyuan_image3_dit.yaml

[Feature] Add AllGather-KV sequence-parallel attention str… (#4968 )

2026-07-24 14:45:26 +00:00

hunyuan_image_3_moe.yaml

[XPU][HunyuanImage3] Fix HunyuanImage-3.0 text-to-image on XPU (#7674 )

2026-09-17 19:23:27 +00:00

hunyuan_video_15.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031 )

2026-07-18 09:34:33 +00:00

hunyuan-image-3-mooncakeconnector.yaml

[Feat] Add native Mooncake KV transfer from AR to DiT (#7166 )

2026-09-20 14:44:55 +00:00

indextts2_5.yaml

[New Model] Support IndexTTS 2.5 (#5957 )

2026-08-11 23:00:35 +00:00

indextts2_low_latency.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

indextts2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

joyai_vl_interaction.yaml

[Model][JoyAI-VL-Interaction] Add native multi-stage pipeline (#5352 )

2026-09-08 05:07:08 -07:00

lance.yaml

[New Model] Add Lance (ByteDance) (#3710 )

2026-06-01 16:01:25 +08:00

lingbot_world_v2_stepwise.yaml

[LingBot World] Shard the streaming VAE decode across the Ulysses ranks (#7651 )

2026-09-21 19:00:46 +08:00

mammoth_moda2_ar.yaml

[Fix] Restore MammothModa2 support (#6694 )

2026-08-28 08:32:32 +08:00

mammoth_moda2_fp8_kv.yaml

[Performance][MammothModa2] Enable and validate FP8 KV cache for AR stage (#7436 )

2026-09-14 00:47:39 -07:00

mammoth_moda2.yaml

[Model] MammothModa2: enable Cache-DiT acceleration for the DiT stage (#7291 )

2026-09-21 18:34:12 -07:00

mimo_audio_5090d.yaml

[Doc] Add MiMo-Audio recipe for RTX 5090/5090D 32GB (#6559 )

2026-08-26 16:26:24 +08:00

mimo_audio.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

ming_flash_omni_image.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

ming_flash_omni_thinker_only.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154 )

2026-05-03 14:43:49 +12:00

ming_flash_omni_tts.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154 )

2026-05-03 14:43:49 +12:00

ming_flash_omni.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154 )

2026-05-03 14:43:49 +12:00

ming_tts_moe.yaml

[Perf] Ming-TTS Stage-0 flow-head speedup: RoPE/QKV fusion, opt-in torch.compile, PIECEWISE cudagraph (#4942 )

2026-07-12 19:50:51 -07:00

ming_tts.yaml

[Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011 )

2026-07-13 06:45:28 +08:00

minicpmo_4_5_2gpu.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416 )

2026-09-16 01:24:31 -07:00

minicpmo_4_5_3gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619 )

2026-08-26 10:56:51 +08:00

minicpmo_4_5_3gpu.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416 )

2026-09-16 01:24:31 -07:00

minicpmo_4_5_4gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619 )

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619 )

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416 )

2026-09-16 01:24:31 -07:00

minicpmo_4_5_turn.yaml

[Frontend] Allow explicit turn-based serving (#7675 )

2026-09-16 17:29:57 -07:00

minicpmo_4_5.yaml

[Benchmark][MiniCPM-o] Port Video-MME dataset support to Omni bench s… (#6987 )

2026-09-20 17:15:53 +08:00

minimax_h3_disaggregated_nixl.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264 )

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated_turbo_nixl.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264 )

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated_turbo.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264 )

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264 )

2026-09-23 18:26:53 +08:00

minimax_music3_2gpu.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

minimax_music3.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

moss_sound_effect.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

moss_tts_80gb.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

moss_tts_local_2npu.yaml

[tts][feature][NPU] Add 2-NPU and 3-NPU disaggregated deploy profiles for MOSS-TTS-Local (#7052 )

2026-09-21 23:14:52 +00:00

moss_tts_local_3npu.yaml

[tts][feature][NPU] Add 2-NPU and 3-NPU disaggregated deploy profiles for MOSS-TTS-Local (#7052 )

2026-09-21 23:14:52 +00:00

moss_tts_local_h200.yaml

[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202 )

2026-09-09 13:02:12 -07:00

moss_tts_local.yaml

[Performance] Capture MOSS-TTS codec streaming decode with NPUGraph (#7280 )

2026-09-21 06:38:23 +08:00

moss_tts_nano.yaml

[Hardware][Ascend][Model] Support MOSS-TTS-Nano on Ascend A2 (#7192 )

2026-09-14 15:25:17 -07:00

moss_tts_realtime.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

moss_tts.yaml

[BugFix][TTS] Restore MOSS v1 codec streaming (#6420 )

2026-09-18 20:06:57 +08:00

moss_ttsd.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

moss_voice_generator.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096 )

2026-07-22 09:44:15 +08:00

nemotron_labs_voicechat_duplex.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat_streaming.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

omnivoice.yaml

[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution (#6408 )

2026-09-08 18:58:38 -07:00

personaplex.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522 )

2026-09-17 19:22:14 +00:00

pi0.yaml

Add π0 VLA model support (#4222 )

2026-08-17 14:29:17 +08:00

pi05.yaml

[Model] Add π0.5 (Pi0.5) VLA model support (#6950 )

2026-09-17 05:18:51 -07:00

qwen2_5_omni.yaml

[New Model] Support IndexTTS 2.5 (#5957 )

2026-08-11 23:00:35 +00:00

qwen3_omni_duplex.yaml

[Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222 ) (#7585 )

2026-09-17 23:32:31 +08:00

qwen3_omni_moe_mori_intranode.yaml

add moriio transfer engine (#1742 )

2026-06-10 08:37:33 +08:00

qwen3_omni_moe_thinking.yaml

[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284 )

2026-08-27 08:21:03 +00:00

qwen3_omni_moe.yaml

[Bugfix] Fix Qwen3-Omni MoE backend selection (#7019 )

2026-09-04 21:16:58 +08:00

qwen3_tts_forced_aligner.yaml

[Bugfix] Build the forced-aligner prompt without a chat template (word timestamps one bin late) (#7240 )

2026-09-08 19:27:38 +00:00

qwen3_tts_high_concurrency_mrv2_b4.yaml

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

qwen3_tts_high_concurrency_mrv2_single_gpu.yaml

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

qwen3_tts_high_concurrency_mrv2.yaml

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781 )

2026-09-20 23:03:08 -07:00

qwen3_tts_high_concurrency.yaml

[Frontend] Scale Omni serving across API processes (#6923 )

2026-09-16 22:29:31 -07:00

qwen3_tts_mrv2.yaml

[Model] Default Qwen3-TTS to experimental Model Runner V2 (#7930 )

2026-09-21 18:56:06 +00:00

qwen3_tts.yaml

[Model] Default Qwen3-TTS to experimental Model Runner V2 (#7930 )

2026-09-21 18:56:06 +00:00

README_higgs_audio_v3.md

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068 )

2026-08-13 10:00:50 -07:00

step_audio2_ci.yaml

[Bugfix] Fix Step-Audio2 L4 CI KV cache allocation (#6839 )

2026-09-08 14:17:33 +08:00

step_audio_2_asr.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031 )

2026-07-18 09:34:33 +00:00

step_audio_2_async_chunk.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031 )

2026-07-18 09:34:33 +00:00

step_audio_2.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031 )

2026-07-18 09:34:33 +00:00

voxcpm2.yaml

[Bugfix][Qwen3-TTS] Seed residual MTP sampling (#4869 )

2026-07-04 17:47:11 +00:00

voxtral_tts.yaml

[Refactor] Migrate Voxtral TTS XPU stage config to --deploy-config (#5467 )

2026-07-28 07:35:35 +08:00

wan2_2_ti2v.yaml

[Config] Remove diffusion_batch_size and use max_num_seqs instead. (#6484 )

2026-09-01 01:02:54 +00:00