Sy03andzack 1ea0ee3b38 [Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224) ...

Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: zack <huixindaddy@yahoo.com>
Co-authored-by: zack <huixindaddy@yahoo.com>

2026-09-29 15:48:36 +00:00

..

audex_s2s_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_s2s.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_thinker_only_30b.yaml

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

audex_thinker_only.yaml

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

audex_tta_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tta.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tts_30b.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audex_tts.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

audio8_tts.yaml

[Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157)

2026-09-08 19:00:25 -07:00

auk.yaml

[Model] Add Tencent AuK speech generation and editing (encoder + diffusion pipeline) (#7385)

2026-09-11 20:09:58 +00:00

aura_omni.yaml

[Model] Integrate AURA into Full-Duplex Runtime (#7633)

2026-09-21 09:26:54 -07:00

bagel_single_stage.yaml

[Docs] Remove stale stage config references (#6270)

2026-08-20 07:09:12 +08:00

bagel_think.yaml

[Config Refactor]: Remove bagel yaml (#2936)

2026-04-24 21:21:30 +08:00

bagel.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

breeze_tts_2_throughput.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)

2026-09-22 17:10:15 -07:00

breeze_tts_2.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)

2026-09-22 17:10:15 -07:00

breeze_tts_throughput.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)

2026-09-22 17:10:15 -07:00

breeze_tts.yaml

[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)

2026-09-22 17:10:15 -07:00

cosmos3_omni.yaml

[BugFix][Cosmos3] Register opt-in T2I pipeline so deploy-config applies (#7971)

2026-09-24 10:08:46 +00:00

cosmos3_policy_droid.yaml

Cosmos3 action policy improvements (#6460)

2026-09-10 22:32:50 +08:00

cosyvoice3_full_response_high_concurrency_standard.yaml

[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)

2026-09-29 15:48:36 +00:00

cosyvoice3_full_response_high_concurrency.yaml

[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)

2026-09-29 15:48:36 +00:00

cosyvoice3_full_response.yaml

[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)

2026-09-29 15:48:36 +00:00

cosyvoice3_packed_streaming.yaml

[Model] Add opt-in packed Flow and batched HiFT inference for CosyVoice3 (#8224)

2026-09-29 15:48:36 +00:00

cosyvoice3.yaml

[Bugfix][CosyVoice3] Resolve hash snapshot pipeline (#6896)

2026-09-08 20:33:38 -07:00

covo_audio.yaml

[New Model] Add support for tencent/Covo-Audio-Chat (#2293)

2026-05-12 14:39:58 +08:00

dreamzero_tp1_cfg2.yaml

[Bugfix] Select the AR-Diffusion engine in the DreamZero CFG-parallel deploy config (#5439)

2026-07-28 17:14:26 +08:00

dreamzero.yaml

[BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366) (#4534)

2026-07-05 07:17:58 +08:00

fish_qwen3_omni_2gpu.yaml

[Docs] Remove stale stage config references (#6270)

2026-08-20 07:09:12 +08:00

fish_qwen3_omni_high_concurrency_dual_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

fish_qwen3_omni_high_concurrency_single_gpu.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

fish_qwen3_omni.yaml

[BugFix][NPU] Fix Fish Speech S2 Pro NPU support (#7546)

2026-09-16 11:38:06 -07:00

gepard.yaml

[Model] Add Gepard-1.0 native-AR FSQ/NanoCodec TTS (offline inference) (#5666)

2026-08-14 22:06:05 -07:00

glm_image.yaml

glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config (#3235)

2026-05-27 12:18:47 +12:00

glm_tts.yaml

[Model] Add GLM-TTS text-to-speech model support (#3141)

2026-05-24 05:42:26 +08:00

Gr00tN1d7.yaml

[Diffusion] add GR00T-N1.7 pipeline with OpenPI serving (#3798)

2026-06-20 11:45:26 +08:00

higgs_audio_v2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

higgs_multimodal_qwen3_high_throughput.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3_low_latency.yaml

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

higgs_multimodal_qwen3.yaml

[BugFix][Higgs-Audio-V3] Fix transcript and concurrent sampling tests (#6422)

2026-08-30 08:52:15 +00:00

hunyuan_image3_ar.yaml

[Config] Add HunyuanImage3 deploy configs (#3172)

2026-05-11 22:49:19 +08:00

hunyuan_image3_dit.yaml

[Feature] Add AllGather-KV sequence-parallel attention str… (#4968)

2026-07-24 14:45:26 +00:00

hunyuan_image_3_moe.yaml

[XPU][HunyuanImage3] Fix HunyuanImage-3.0 text-to-image on XPU (#7674)

2026-09-17 19:23:27 +00:00

hunyuan_video_15.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

hunyuan-image-3-mooncakeconnector.yaml

[Feat] Add native Mooncake KV transfer from AR to DiT (#7166)

2026-09-20 14:44:55 +00:00

indextts2_5.yaml

[New Model] Support IndexTTS 2.5 (#5957)

2026-08-11 23:00:35 +00:00

indextts2_low_latency.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

indextts2.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

joyai_vl_interaction.yaml

[Model][JoyAI-VL-Interaction] Add native multi-stage pipeline (#5352)

2026-09-08 05:07:08 -07:00

lance.yaml

[New Model] Add Lance (ByteDance) (#3710)

2026-06-01 16:01:25 +08:00

lingbot_world_v2_stepwise.yaml

[LingBot World] Shard the streaming VAE decode across the Ulysses ranks (#7651)

2026-09-21 19:00:46 +08:00

mammoth_moda2_ar.yaml

[Fix] Restore MammothModa2 support (#6694)

2026-08-28 08:32:32 +08:00

mammoth_moda2_fp8_kv.yaml

[Bugfix][MammothModa2] Keep AR layer 0 in BF16 in the FP8 KV preset (#8083)

2026-09-25 21:25:49 +08:00

mammoth_moda2.yaml

[Model] Support request-level batching for MammothModa2 DiT on shared runtime (#7476)

2026-09-25 10:34:59 +08:00

mimo_audio_5090d.yaml

[Doc] Add MiMo-Audio recipe for RTX 5090/5090D 32GB (#6559)

2026-08-26 16:26:24 +08:00

mimo_audio.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

ming_flash_omni_image.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

ming_flash_omni_thinker_only.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni_tts.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_image.yaml

[New Model] Ming-Image (inclusionAI/Ming-Image-0.1-Design) Support (#8021)

2026-09-23 12:20:06 +00:00

ming_tts_moe.yaml

[Perf] Ming-TTS Stage-0 flow-head speedup: RoPE/QKV fusion, opt-in torch.compile, PIECEWISE cudagraph (#4942)

2026-07-12 19:50:51 -07:00

ming_tts.yaml

[Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011)

2026-07-13 06:45:28 +08:00

minicpmo_4_5_2gpu.yaml

[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)

2026-09-29 09:14:12 +10:00

minicpmo_4_5_3gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_3gpu.yaml

[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)

2026-09-29 09:14:12 +10:00

minicpmo_4_5_4gpu_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090_stage1_replicas.yaml

[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)

2026-08-26 10:56:51 +08:00

minicpmo_4_5_8x4090.yaml

[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)

2026-09-29 09:14:12 +10:00

minicpmo_4_5_turn.yaml

[Frontend] Allow explicit turn-based serving (#7675)

2026-09-16 17:29:57 -07:00

minicpmo_4_5.yaml

[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)

2026-09-29 09:14:12 +10:00

minimax_h3_disaggregated_nixl.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated_turbo_nixl.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated_turbo.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)

2026-09-23 18:26:53 +08:00

minimax_h3_disaggregated.yaml

[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)

2026-09-23 18:26:53 +08:00

minimax_music3_2gpu.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

minimax_music3.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

moss_sound_effect.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts_80gb.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts_local_2npu.yaml

[tts][feature][NPU] Add 2-NPU and 3-NPU disaggregated deploy profiles for MOSS-TTS-Local (#7052)

2026-09-21 23:14:52 +00:00

moss_tts_local_3npu.yaml

[tts][feature][NPU] Add 2-NPU and 3-NPU disaggregated deploy profiles for MOSS-TTS-Local (#7052)

2026-09-21 23:14:52 +00:00

moss_tts_local_h200.yaml

[Frontend] Tune reference cache limits and registered MOSS voice requests (#7883)

2026-09-29 04:10:17 +00:00

moss_tts_local.yaml

[Frontend] Tune reference cache limits and registered MOSS voice requests (#7883)

2026-09-29 04:10:17 +00:00

moss_tts_nano.yaml

[Hardware][Ascend][Model] Support MOSS-TTS-Nano on Ascend A2 (#7192)

2026-09-14 15:25:17 -07:00

moss_tts_realtime.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_tts.yaml

[BugFix][TTS] Restore MOSS v1 codec streaming (#6420)

2026-09-18 20:06:57 +08:00

moss_ttsd.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

moss_voice_generator.yaml

[Core] Cleanup Omni connector runtime and transfer backends (#5096)

2026-07-22 09:44:15 +08:00

nemotron_labs_voicechat_duplex.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat_streaming.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

nemotron_labs_voicechat.yaml

[Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)

2026-09-17 19:22:14 +00:00

omnivoice.yaml

[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution (#6408)

2026-09-08 18:58:38 -07:00

personaplex.yaml

[Perf][PersonaPlex] Serve 16 concurrent realtime duplex sessions on one GPU (#8192)

2026-09-28 04:51:38 +00:00

pi0.yaml

Add π0 VLA model support (#4222)

2026-08-17 14:29:17 +08:00

pi05.yaml

[Model] Add π0.5 (Pi0.5) VLA model support (#6950)

2026-09-17 05:18:51 -07:00

qwen2_5_omni.yaml

[New Model] Support IndexTTS 2.5 (#5957)

2026-08-11 23:00:35 +00:00

qwen3_omni_duplex.yaml

[Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585)

2026-09-17 23:32:31 +08:00

qwen3_omni_moe_mori_intranode.yaml

add moriio transfer engine (#1742)

2026-06-10 08:37:33 +08:00

qwen3_omni_moe_thinking.yaml

[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284)

2026-08-27 08:21:03 +00:00

qwen3_omni_moe.yaml

[Bugfix][Qwen3-Omni] Restore the talker sampling seed (#7474)

2026-09-24 17:41:03 -07:00

qwen3_tts_forced_aligner.yaml

[Bugfix] Build the forced-aligner prompt without a chat template (word timestamps one bin late) (#7240)

2026-09-08 19:27:38 +00:00

qwen3_tts_high_concurrency_mrv2_b4.yaml

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)

2026-09-20 23:03:08 -07:00

qwen3_tts_high_concurrency_mrv2_single_gpu.yaml

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)

2026-09-26 22:51:04 +08:00

qwen3_tts_high_concurrency_mrv2.yaml

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)

2026-09-26 22:51:04 +08:00

qwen3_tts_high_concurrency.yaml

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)

2026-09-26 22:51:04 +08:00

qwen3_tts_mrv2.yaml

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)

2026-09-26 22:51:04 +08:00

qwen3_tts.yaml

[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)

2026-09-26 22:51:04 +08:00

README_higgs_audio_v3.md

[Bugfix][Higgs-Audio-V3] Disable XQA decode (#6068)

2026-08-13 10:00:50 -07:00

step_audio2_ci.yaml

[Bugfix] Fix Step-Audio2 L4 CI KV cache allocation (#6839)

2026-09-08 14:17:33 +08:00

step_audio_2_asr.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

step_audio_2_async_chunk.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

step_audio_2.yaml

[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)

2026-07-18 09:34:33 +00:00

voxcpm2.yaml

[Bugfix][Qwen3-TTS] Seed residual MTP sampling (#4869)

2026-07-04 17:47:11 +00:00

voxtral_tts.yaml

[Refactor] Migrate Voxtral TTS XPU stage config to --deploy-config (#5467)

2026-07-28 07:35:35 +08:00

wan2_2_ti2v.yaml

[Config] Remove diffusion_batch_size and use max_num_seqs instead. (#6484)

2026-09-01 01:02:54 +00:00