3 people 470ec60848 [Core] Refactor omni prefix cache into Manager/Controller (#6654) ...

Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-09-19 21:23:59 +08:00

..

audex_s2s_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_s2s.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_thinker_only_30b.yaml

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

audex_thinker_only.yaml

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

audex_tta_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tta.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tts_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tts.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audio8_tts.yaml

[Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157)

2026-09-08 19:00:25 -07:00

auk.yaml

[Model] Add Tencent AuK speech generation and editing (encoder + diffusion pipeline) (#7385)

2026-09-11 20:09:58 +00:00

aura_omni.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

bagel_single_stage.yaml

[Docs] Remove stale stage config references (#6270)

2026-08-20 07:09:12 +08:00

bagel_think.yaml

[Config Refactor]: Remove bagel yaml (#2936)

2026-04-24 21:21:30 +08:00

bagel.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

breeze_tts_2.yaml

[Bugfix] Fix Breeze-TTS-2 repeated silence and audio EOS handling

2026-09-16 18:40:12 +00:00

cosmos3_policy_droid.yaml

Cosmos3 action policy improvements (#6460)

2026-09-10 22:32:50 +08:00

cosyvoice3.yaml

[Bugfix][CosyVoice3] Resolve hash snapshot pipeline (#6896)

2026-09-08 20:33:38 -07:00

covo_audio.yaml

[New Model] Add support for tencent/Covo-Audio-Chat (#2293)

2026-05-12 14:39:58 +08:00

dots_tts.yaml

[Model][TTS][WIP] Add dots.tts (rednote-hilab) — continuous-AR 48kHz TTS (#4765)

2026-08-13 17:58:33 +00:00

dreamzero_tp1_cfg2.yaml

[Bugfix] Select the AR-Diffusion engine in the DreamZero CFG-parallel deploy config (#5439)

2026-07-28 17:14:26 +08:00

dreamzero.yaml

[BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366) (#4534)

2026-07-05 07:17:58 +08:00

dynin_omni_ci.yaml

[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… (#4078)

2026-06-02 21:28:12 +00:00

dynin_omni_multiconnector.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

dynin_omni.yaml

[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… (#4078)

2026-06-02 21:28:12 +00:00

fish_qwen3_omni_2gpu.yaml

[Docs] Remove stale stage config references (#6270)

2026-08-20 07:09:12 +08:00

fish_qwen3_omni_high_concurrency_dual_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

fish_qwen3_omni_high_concurrency_single_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

fish_qwen3_omni.yaml

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546)

2026-09-16 11:38:06 -07:00

gepard.yaml

[Model] Add Gepard-1.0 native-AR FSQ/NanoCodec TTS (offline inference) (#5666)

2026-08-14 22:06:05 -07:00

glm_image.yaml

glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config (#3235)

2026-05-27 12:18:47 +12:00

glm_tts.yaml

[Model] Add GLM-TTS text-to-speech model support (#3141)

2026-05-24 05:42:26 +08:00

Gr00tN1d7.yaml

[Diffusion] add GR00T-N1.7 pipeline with OpenPI serving (#3798)

2026-06-20 11:45:26 +08:00

higgs_audio_v2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

higgs_multimodal_qwen3_high_throughput.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3_low_latency.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3.yaml

[BugFix][Higgs-Audio-V3] Fix transcript and concurrent sampling tests (#6422)

2026-08-30 08:52:15 +00:00

hunyuan_image3_ar.yaml

[Config] Add HunyuanImage3 deploy configs (#3172)

2026-05-11 22:49:19 +08:00

hunyuan_image3_dit.yaml

[Feature] Add AllGather-KV sequence-parallel attention str… (#4968)

2026-07-24 14:45:26 +00:00

hunyuan_image_3_moe.yaml

[XPU][HunyuanImage3] Fix HunyuanImage-3.0 text-to-image on XPU (#7674)

2026-09-17 19:23:27 +00:00

hunyuan_video_15.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

indextts2_5.yaml

[New Model] Support IndexTTS 2.5 (#5957)

2026-08-11 23:00:35 +00:00

indextts2_low_latency.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

indextts2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

joyai_vl_interaction.yaml

[Model][JoyAI-VL-Interaction] Add native multi-stage pipeline (#5352)

2026-09-08 05:07:08 -07:00

lance.yaml

[New Model] Add Lance (ByteDance) (#3710)

2026-06-01 16:01:25 +08:00

lingbot_world_v2_stepwise.yaml

[Feature][LingBot World]stepwise execution (#6844)

2026-09-07 13:38:23 +08:00

mammoth_moda2_ar.yaml

[Fix] Restore MammothModa2 support (#6694)

2026-08-28 08:32:32 +08:00

mammoth_moda2_fp8_kv.yaml

[Performance][MammothModa2] Enable and validate FP8 KV cache for AR stage (#7436)

2026-09-14 00:47:39 -07:00

mammoth_moda2.yaml

[Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134)

2026-09-18 13:29:18 -07:00

mimo_audio_5090d.yaml

[Doc] Add MiMo-Audio recipe for RTX 5090/5090D 32GB (#6559)

2026-08-26 16:26:24 +08:00

mimo_audio.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

ming_flash_omni_image.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

ming_flash_omni_thinker_only.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni_tts.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_tts_moe.yaml

[Perf] Ming-TTS Stage-0 flow-head speedup: RoPE/QKV fusion, opt-in torch.compile, PIECEWISE cudagraph (#4942)

2026-07-12 19:50:51 -07:00

ming_tts.yaml

[Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011)

2026-07-13 06:45:28 +08:00

minicpmo_4_5_2gpu.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416)

2026-09-16 01:24:31 -07:00

minicpmo_4_5_3gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_3gpu.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416)

2026-09-16 01:24:31 -07:00

minicpmo_4_5_4gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090.yaml

[Bugfix][MiniCPM-o] Stabilize code2wav CFM CUDA graph caching with reference audio normalization and mel-frame bucketing (#7416)

2026-09-16 01:24:31 -07:00

minicpmo_4_5_turn.yaml

[Frontend] Allow explicit turn-based serving (#7675)

2026-09-16 17:29:57 -07:00

minicpmo_4_5.yaml

[Frontend] Allow explicit turn-based serving (#7675)

2026-09-16 17:29:57 -07:00

minimax_h3_disaggregated_turbo.yaml

[feat] Extend disaggregated MiniMax-H3 stage with VAE encoders (#6939)

2026-09-16 16:52:35 +08:00

minimax_h3_disaggregated.yaml

[feat] Extend disaggregated MiniMax-H3 stage with VAE encoders (#6939)

2026-09-16 16:52:35 +08:00

minimax_music3_2gpu.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

minimax_music3.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

moss_sound_effect.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts_80gb.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts_local_h200.yaml

[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202)

2026-09-09 13:02:12 -07:00

moss_tts_local.yaml

[BugFix] Use MOSS-TTS-Local official sample params (#6156)

2026-08-13 08:56:26 +00:00

moss_tts_nano.yaml

[Hardware][Ascend][Model] Support MOSS-TTS-Nano on Ascend A2 (#7192)

2026-09-14 15:25:17 -07:00

moss_tts_realtime.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts.yaml

[BugFix][TTS] Restore MOSS v1 codec streaming (#6420)

2026-09-18 20:06:57 +08:00

moss_ttsd.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_voice_generator.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

nemotron_labs_voicechat_duplex.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat_streaming.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

omnivoice.yaml

[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution (#6408)

2026-09-08 18:58:38 -07:00

personaplex.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

pi0.yaml

Add π0 VLA model support (#4222)

2026-08-17 14:29:17 +08:00

pi05.yaml

[Model] Add π0.5 (Pi0.5) VLA model support (#6950)

2026-09-17 05:18:51 -07:00

qwen2_5_omni.yaml

[New Model] Support IndexTTS 2.5 (#5957)

2026-08-11 23:00:35 +00:00

qwen3_omni_duplex.yaml

[Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585)

2026-09-17 23:32:31 +08:00

qwen3_omni_moe_mori_intranode.yaml

add moriio transfer engine (#1742)

2026-06-10 08:37:33 +08:00

qwen3_omni_moe_thinking.yaml

[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284)

2026-08-27 08:21:03 +00:00

qwen3_omni_moe.yaml

[Bugfix] Fix Qwen3-Omni MoE backend selection (#7019)

2026-09-04 21:16:58 +08:00

qwen3_tts_forced_aligner.yaml

[Bugfix] Build the forced-aligner prompt without a chat template (word timestamps one bin late) (#7240)

2026-09-08 19:27:38 +00:00

qwen3_tts_high_concurrency.yaml

[Frontend] Scale Omni serving across API processes (#6923)

2026-09-16 22:29:31 -07:00

qwen3_tts.yaml

[Core] Refactor omni prefix cache into Manager/Controller (#6654)

2026-09-19 21:23:59 +08:00

README_higgs_audio_v3.md

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

step_audio2_ci.yaml

[Bugfix] Fix Step-Audio2 L4 CI KV cache allocation (#6839)

2026-09-08 14:17:33 +08:00

step_audio_2_asr.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

step_audio_2_async_chunk.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

step_audio_2.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

voxcpm2.yaml

[Bugfix][Qwen3-TTS] Seed residual MTP sampling (#4869)

2026-07-04 17:47:11 +00:00

voxtral_tts.yaml

[Refactor] Migrate Voxtral TTS XPU stage config to --deploy-config (#5467)

2026-07-28 07:35:35 +08:00

wan2_2_ti2v.yaml

[Config] Remove diffusion_batch_size and use max_num_seqs instead. (#6484)

2026-09-01 01:02:54 +00:00