3 people 6853d7204d [Bugfix] Add single-80GB deploy config for MOSS-TTS (resolves #4643 OOM) (#4761) ...

Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
Signed-off-by: Inesh Reddy Chappidi <ineshreddy249@gmail.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-07-18 13:49:10 +08:00

..

aura_omni.yaml

[Bugfix] [AURA] Correct aura results when use qwen3-tts in custom voice mode (#4650)

2026-06-24 17:29:48 +08:00

bagel_single_stage.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00

bagel_think.yaml

[Config Refactor]: Remove bagel yaml (#2936)

2026-04-24 21:21:30 +08:00

bagel.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00

cosyvoice3.yaml

[Perf][TTS] Optimize cosyvoice TTFP and throughput using TensorRT (#4168)

2026-06-10 16:42:34 +08:00

covo_audio.yaml

[New Model] Add support for tencent/Covo-Audio-Chat (#2293)

2026-05-12 14:39:58 +08:00

dreamzero_tp1_cfg2.yaml

[Perf][DreamZero]dreamzero supports CUDA graph, torch.compile, and DiT Caching. (#4213)

2026-06-19 14:24:37 +08:00

dreamzero.yaml

[BDE] Phase 1: engine-level KV cache management for DreamZero (RFC #4366) (#4534)

2026-07-05 07:17:58 +08:00

dynin_omni_ci.yaml

[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… (#4078)

2026-06-02 21:28:12 +00:00

dynin_omni_multiconnector.yaml

[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… (#4078)

2026-06-02 21:28:12 +00:00

dynin_omni.yaml

[Refactor] Migrate dynin_omni to pipeline registry, drop legacy stage… (#4078)

2026-06-02 21:28:12 +00:00

fish_qwen3_omni_2gpu.yaml

[Recipe] Add Fish Speech S2 Pro 2-GPU deploy profile (#3323)

2026-05-22 20:14:03 +08:00

fish_qwen3_omni_high_concurrency_dual_gpu.yaml

[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving (#3773)

2026-05-27 13:25:49 -05:00

fish_qwen3_omni_high_concurrency_single_gpu.yaml

[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving (#3773)

2026-05-27 13:25:49 -05:00

fish_qwen3_omni.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00

glm_image.yaml

glm-image: fix(npu)per-stage runtime env for HCCL ports + GLM-Image NPU stage config (#3235)

2026-05-27 12:18:47 +12:00

glm_tts.yaml

[Model] Add GLM-TTS text-to-speech model support (#3141)

2026-05-24 05:42:26 +08:00

Gr00tN1d7.yaml

[Diffusion] add GR00T-N1.7 pipeline with OpenPI serving (#3798)

2026-06-20 11:45:26 +08:00

higgs_audio_v2.yaml

[Higgs-Audio] bosonai/higgs-audio-v2-generation-3B-base TTS model support (#3762)

2026-05-25 23:16:07 +08:00

higgs_multimodal_qwen3_high_throughput.yaml

[Perf] Optimize Higgs Audio v3 serving (#4204)

2026-06-11 13:29:31 -07:00

higgs_multimodal_qwen3_low_latency.yaml

[Perf] Optimize Higgs Audio v3 serving (#4204)

2026-06-11 13:29:31 -07:00

higgs_multimodal_qwen3.yaml

[Perf] Optimize Higgs Audio v3 serving (#4204)

2026-06-11 13:29:31 -07:00

hunyuan_image3_ar.yaml

[Config] Add HunyuanImage3 deploy configs (#3172)

2026-05-11 22:49:19 +08:00

hunyuan_image3_dit.yaml

[Config] Add HunyuanImage3 deploy configs (#3172)

2026-05-11 22:49:19 +08:00

hunyuan_image_3_moe.yaml

[Core] hunyuan-image prefetch kv (#4448)

2026-06-25 21:31:49 +08:00

indextts2_low_latency.yaml

[Model] Add IndexTTS2 text-to-speech support (#3838)

2026-06-22 19:24:01 +00:00

indextts2.yaml

[Model] Add IndexTTS2 text-to-speech support (#3838)

2026-06-22 19:24:01 +00:00

lance.yaml

[New Model] Add Lance (ByteDance) (#3710)

2026-06-01 16:01:25 +08:00

mammoth_moda2_ar.yaml

[Refactor] Migrate MammothModa2 and OmniVoice to pipeline registry (#4647)

2026-07-08 00:44:33 +00:00

mammoth_moda2.yaml

[Refactor] Migrate MammothModa2 and OmniVoice to pipeline registry (#4647)

2026-07-08 00:44:33 +00:00

mimo_audio.yaml

[Docs] Fix hallucinated stage CLI flags in documentation and comments (#4512)

2026-06-17 20:49:56 +08:00

ming_flash_omni_image.yaml

[Config Refactor] Migrate Ming-flash-omni-2.0 Image-Gen deploy configs (#3975)

2026-05-30 08:13:21 +00:00

ming_flash_omni_thinker_only.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni_tts.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_flash_omni.yaml

[Config Refactor] Migrate Ming and Ming-TTS deploy/pipline configs (#3154)

2026-05-03 14:43:49 +12:00

ming_tts_moe.yaml

[Perf] Ming-TTS Stage-0 flow-head speedup: RoPE/QKV fusion, opt-in torch.compile, PIECEWISE cudagraph (#4942)

2026-07-12 19:50:51 -07:00

ming_tts.yaml

[Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011)

2026-07-13 06:45:28 +08:00

minicpmo_4_5_3gpu.yaml

[Model]Support MiniCPM-o 4.5 (#3642)

2026-06-01 22:12:24 +08:00

minicpmo_4_5_8x4090.yaml

[Model]Support MiniCPM-o 4.5 (#3642)

2026-06-01 22:12:24 +08:00

minicpmo_4_5.yaml

[Model]Support MiniCPM-o 4.5 (#3642)

2026-06-01 22:12:24 +08:00

moss_sound_effect.yaml

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

moss_tts_80gb.yaml

[Bugfix] Add single-80GB deploy config for MOSS-TTS (resolves #4643 OOM) (#4761)

2026-07-18 13:49:10 +08:00

moss_tts_local.yaml

[Feature] Support MOSS-TTS-Local-v1.5 Streaming (#4804)

2026-07-03 16:00:30 +08:00

moss_tts_nano.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00

moss_tts_realtime.yaml

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

moss_tts.yaml

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

moss_ttsd.yaml

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

moss_voice_generator.yaml

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

omnivoice.yaml

[Refactor] Migrate MammothModa2 and OmniVoice to pipeline registry (#4647)

2026-07-08 00:44:33 +00:00

qwen2_5_omni.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00

qwen3_omni_moe_mori_intranode.yaml

add moriio transfer engine (#1742)

2026-06-10 08:37:33 +08:00

qwen3_omni_moe.yaml

[Refactor][Phase 1]Remove redundant functions and logs (#4986)

2026-07-10 15:13:35 +08:00

qwen3_tts_forced_aligner.yaml

[Feat] Streaming TTS word-level timestamps via forced aligner (#4034)

2026-06-22 04:51:45 +00:00

qwen3_tts_high_concurrency.yaml

[Bugfix] Drop out-of-vocabulary stop ids from min-tokens masking (qwen3-tts min_tokens engine crash) (#4971)

2026-07-08 11:24:31 -07:00

qwen3_tts.yaml

[Perf][Qwen3-TTS] Align talker MTP CUDA graph capture with Qwen3-Omni & Adapt to async output (#4923)

2026-07-10 11:11:29 +08:00

README_higgs_audio_v3.md

[Perf] Optimize Higgs Audio v3 serving (#4204)

2026-06-11 13:29:31 -07:00

soulxsinger_svc.yaml

[Model] add soulx-singer support (#3862)

2026-06-24 05:36:45 +00:00

soulxsinger_svs.yaml

[Model] add soulx-singer support (#3862)

2026-06-24 05:36:45 +00:00

voxcpm2.yaml

[Bugfix][Qwen3-TTS] Seed residual MTP sampling (#4869)

2026-07-04 17:47:11 +00:00

voxtral_tts.yaml

[BugFix] Fix Whitelist optimization CI failure (#3290)

2026-05-06 14:25:20 +08:00