tzhouamandClaude Fable 5.1 3085f50160 [Edge][CPU] Compile the per-sub-step lm head + top-k Gumbel sampling + embedding + projection into one graph ...

Noise is drawn eagerly with the request generators (same RNG consumption as the
eager loop) and passed in, so the compiled post-step is generator-free and
shape-static; used on the fp32/torchao CPU path outside stored (top-p) mode.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-10 03:12:40 +08:00

..

common

[Edge][CPU] Compile the per-sub-step lm head + top-k Gumbel sampling + embedding + projection into one graph

2026-09-10 03:12:40 +08:00

cosyvoice3

[Bugfix][TTS] Make CosyVoice3 TRT plan publication concurrency-safe (#6955)

2026-09-03 06:44:42 +00:00

dots_tts

[Model][TTS][WIP] Add dots.tts (rednote-hilab) — continuous-AR 48kHz TTS (#4765)

2026-08-13 17:58:33 +00:00

dynin_omni

[Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951)

2026-07-29 23:53:03 +08:00

fish_speech

[Refactor][CI] Reorganize test tree, and move slow e2e to weekly (#4951)

2026-07-29 23:53:03 +08:00

glm_image

[Perf][GLM-Image] Skip redundant hidden state D2H (#5346)

2026-07-28 20:34:35 +08:00

higgs_audio_v3

[Bugfix] Fix Higgs Audio v3 voice-clone token validation (#7065)

2026-09-04 16:06:47 -07:00

indextts2

[Bugfix] Fix fallback loading for IndexTTS external models (#6137)

2026-09-04 19:58:33 -07:00

mammoth_moda2

[Fix] Restore MammothModa2 support (#6694)

2026-08-28 08:32:32 +08:00

mimo_audio

[Bugfix][Perf] mimo_audio: fix per-request speech-code routing under continuous batching (#5070)

2026-07-20 17:22:45 +00:00

ming_flash_omni

[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. (#3365)

2026-05-07 23:23:59 +08:00

ming_tts

[Ming] Cleanup Ming-family shared modules (#6119)

2026-08-19 14:13:40 +08:00

minicpmo_4_5

[Model] Preserve MiniCPM-o Talker full attention until capacity (#6799)

2026-09-06 22:25:35 +08:00

moss_tts

[Feature][Moss-TTS] Reference Audio Preprocessing (#4982)

2026-09-04 16:36:26 -07:00

nemotron_voicechat

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)

2026-09-05 08:20:21 +00:00

omnivoice

[Perf][Bugfix][OmniVoice] Restore float16 serving, and fuse the generator hot loop (#6317)

2026-09-02 19:54:55 +00:00

personaplex

[Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196)

2026-09-05 08:20:21 +00:00

qwen2_5_omni

[Rebase] Rebase to vllm 0.27.0 (#5976)

2026-08-11 15:23:46 +00:00

qwen3_omni

[Bugfix][Qwen3-Omni] Handle missing packed modules mapping (#6748)

2026-08-29 15:24:49 +08:00

qwen3_tts

[Edge][CPU] KV-cached code predictor, int8-dynamic CPU fast path, model-side CPU sampler

2026-09-10 01:56:00 +08:00

step_audio2

[Bugfix][TTS] Isolate concurrent StepAudio2 TRT builds (#6957)

2026-09-02 19:53:02 +00:00

voxcpm2

[Refactor] Worker/ModelRunner runner correctness fixes (G2/N) (#5452)

2026-08-20 16:47:50 +08:00

voxtral_tts

[CI]Split GPU jobs by cards_* and reject hand-written SKU marks (#6650)

2026-08-29 18:42:33 +08:00

registry.py

[Bugfix] Fix omni processing test for non-multimodal talker stage (#3559)

2026-05-13 10:08:23 +08:00

test_aura_qwen3_vl.py

[Model] Aura support - Non async chunk path (#4257)

2026-06-21 22:08:26 +08:00

test_encoder_quant_config.py

[diffusion][feature] Add offline SVDQuant W4A4 support (#6162)

2026-08-27 08:45:53 +08:00

test_gepard_window.py

[Model] Add Gepard-1.0 native-AR FSQ/NanoCodec TTS (offline inference) (#5666)

2026-08-14 22:06:05 -07:00

test_gepard_wiring.py

[Refactor] Worker/ModelRunner runner correctness fixes (G2/N) (#5452)

2026-08-20 16:47:50 +08:00

test_glm_tts_prompt_len.py

[Model] Add GLM-TTS text-to-speech model support (#3141)

2026-05-24 05:42:26 +08:00

test_kv_cache_scale_mapper.py

[Bugfix] Fix Hunyuan Image-3 expert mapping contract (#7021)

2026-09-06 21:43:37 +08:00

test_minimax_h3_token_tags.py

[Model] MiniMax-H3: validate versioned text-conditioning handoff (#6720)

2026-09-06 21:45:10 +08:00

test_minimax_music3_batch_payload.py

[Model] Add MiniMax Music 3 text-to-music (#6186)

2026-08-18 04:33:13 +00:00

test_minimax_music3_frame_state.py

[Model] Add MiniMax Music 3 text-to-music (#6186)

2026-08-18 04:33:13 +00:00

test_minimax_music3_prompt.py

[Model] Add MiniMax Music 3 text-to-music (#6186)

2026-08-18 04:33:13 +00:00

test_minimax_music3_repo_root.py

[Bugfix][MiniMax-Music3] Resolve stage subdirs against a real snapshot (#6640)

2026-08-30 06:51:24 +00:00

test_minimax_music3_row_binding.py

[Model] Add MiniMax Music 3 text-to-music (#6186)

2026-08-18 04:33:13 +00:00

test_nemotron_voicechat_perception_window.py

[Perf][NemotronVoiceChat] Fast defaults for all three deploy profiles: 2.8x offline, realtime full-duplex audio (#6354)

2026-09-03 18:49:19 -07:00

test_nemotron_voicechat_registration.py

[Core] Validate PipelineConfig in __post_init__ (#6829)

2026-09-01 11:17:57 +08:00

test_nemotron_voicechat_shapes.py

[Perf][NemotronVoiceChat] Fast defaults for all three deploy profiles: 2.8x offline, realtime full-duplex audio (#6354)

2026-09-03 18:49:19 -07:00

test_nemotron_voicechat_talker_replay.py

[Perf][NemotronVoiceChat] Fast defaults for all three deploy profiles: 2.8x offline, realtime full-duplex audio (#6354)

2026-09-03 18:49:19 -07:00

test_omni_processing.py

[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers (#2556)

2026-05-08 14:12:23 +08:00