Yueqian Lin
74522ca3ec
Merge branch 'main' into feat/moss-tts-nano
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-24 11:00:13 -04:00
7b876324c2
[Feature] Streaming video input with EVS frame filtering (RFC #2201 Phase 2-4) ( #2342 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: shimei.jmh <shimei.jmh@taobao.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-24 22:54:35 +08:00
Haco and lishunyang
22ffb85063
[Config Refactor] sentinel default precedence ( #3078 )
...
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: xiaohajiayou <923390377@qq.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-04-24 20:07:24 +08:00
Lancer
0fe76857ac
[Bugfix] fix GLM-Image multi-stage online generation fail ( #3084 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-04-24 20:00:14 +08:00
3a32cd6780
[Model] Ming-flash-omni-2.0 Omni-Speech and TTS ( #2890 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-23 12:04:52 +08:00
WeiQing Chen
f327cd1c89
[Bugfix] Fix default sampling params for /v1/videos on main ( #3049 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-23 11:31:13 +08:00
wuhang
fd9a0ee27f
[Feature] Failure message shows more details ( #2961 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
2026-04-23 04:32:43 +08:00
NumberWan
ead87aa521
[BugFix] Surface diffusion metrics in chat completions; sanitize Bagel img2img mm kwargs ( #2932 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
2026-04-22 16:57:01 +00:00
Chen-Yo Sun and Yueqian Lin
8e1bbc9ab5
[Feature][Voxtral TTS] Support per-model extra sampling params & add cfg_alpha for Voxtral TTS ( #2338 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-22 03:49:50 +00:00
Yueqian Lin
26bbe7b527
fix(moss_tts_nano): address PR review feedback
...
- Wire ref_audio through /v1/audio/speech: _build_moss_tts_params is now
async, resolves ref_audio via MediaConnector and passes the waveform as
prompt_audio_array so the model can materialise a temp WAV for upstream
inference_stream (previously voice cloning via the REST endpoint was a
no-op). Serving now also requires ref_text when ref_audio is provided.
- Fix per-request EOS in batched decode: replace the shared
_ar_emit_stop_token bool with a _ar_last_chunk_flags list so
compute_logits emits EOS per row; finished requests no longer wait for
the slowest peer in a max_num_seqs=4 batch.
- Snapshot and restore CPU+CUDA RNG state around torch.manual_seed to
limit global-state bleed; add comment noting deterministic output
under concurrent batching is best-effort (upstream inference_stream
uses the global RNG).
- Align _DEFAULT_MODE with the offline example and tests ("voice_clone").
- Clean up outdated "buffer first" comment in _create_stream_gen; document
single-threaded AR-worker assumption for _stream_gens; add one-liner
explaining the load_weights iterator drain.
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-21 17:58:50 -04:00
Yueqian Lin
3bd77d3f8f
Merge branch 'main' into feat/moss-tts-nano
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-21 17:50:21 -04:00
WeiQing Chen
0cdec8210f
[Bugfix] ComfyUI image-to-image DALL-E endpoint cases #2886 ( #2980 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-21 21:37:52 +08:00
52b53367ef
[Enhancement] Engine runtime errors ( #2426 )
...
Signed-off-by: Daniel Huang <daniel1.huang@intel.com >
Signed-off-by: Daniel Huang <pilotflyer824@gmail.com >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Chenguang Zheng <645327136@qq.com >
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: bjf-frz <frz123db@gmail.com >
2026-04-21 14:46:05 +08:00
Vensen
e076378df1
[Feat][sleepmode] add omni sleepmode and ack protocol ( #2022 )
2026-04-21 08:19:53 +08:00
Jared Wen and Hongsheng Liu
7e28eda929
[Bugfix] Fix GLM-Image output dimensions and image edit pipeline ( #2320 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: Jared Wen <w13431838023@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-20 19:24:06 +08:00
93beef17aa
[Bugfix] diffusion end points allow model mismatch ( #2805 )
...
Signed-off-by: xiaohajiayou <923390377@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-20 00:21:03 +08:00
Sy03
a683b1dd75
[Bugfix][VoxCPM2] Fix voice-clone decode loop by padding prefill prompt ( #2894 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-04-18 14:04:44 +00:00
ChenWenjing
4124a1f858
[Feature]Support audio streaming input and output-phase2 ( #2581 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-04-18 15:42:41 +08:00
6b7be88cd5
Fix NoneType error of outputs ( #2315 )
...
Signed-off-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-17 20:10:24 +08:00
Lancer and Hongsheng Liu
cf75ae6ed5
[Bugfix] Fix image quality in /v1/images/generations for multi-stage pipeline ( #2267 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-17 20:09:41 +08:00
WeiQing Chen and Gao Han
f658bcb0bf
[Bugfix] Limit Qwen-Image-Edit-2511 input image count ( #2840 )
...
Signed-off-by: david6666666 <530634352@qq.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-04-17 20:07:30 +08:00
Lancer and Hongsheng Liu
bf64a6b841
[Feature] Flux2 klein inpaint ( #1180 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-17 07:55:00 +08:00
Sy03
7d64a7c996
[BugFix][VoxCPM2]: split multichar Chinese tokens to match training tokenization ( #2832 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-04-16 10:07:48 -05:00
2ec91d4dfd
[FIX] Preserve YAML default stop words when request sends empty list ( #2855 )
...
Signed-off-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
2026-04-16 14:40:34 +00:00
NATURE and Hongsheng Liu
4d816ff1de
[Feature] Bagel: Support tp+cfg parallel using mooncake transfer engine connector ( #2705 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-16 16:25:13 +08:00
4bf4c63147
Add voxcpm model support. ( #2467 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: IsleOfDawnlight <stellamou@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Celeste-jq <591998922@qq.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-15 15:04:58 +08:00
WeiQing Chen
6c6551dff8
[Feature] feat: add video frame interpolation postprocess ( #2555 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-04-15 11:52:20 +08:00
Samit
61a3cbdff5
[Perf] Eliminate Hop 3 IPC overhead for single-stage diffusion via inline execution ( #2736 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
2026-04-15 11:46:06 +08:00
rongfu.leng
9e46a79c17
[Bugfix] Handle numpy array outputs when generate image ( #1680 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
2026-04-15 08:52:32 +08:00
Yueqian Lin
fc81b8504a
feat(moss-tts-nano): add online serving, Gradio demo, and fix /v1/audio/speech integration
...
- Register moss_tts_nano as TTS model stage in serving_speech.py
(model detection, validation, prompt building)
- Fix registry mod_relname: moss_tts_nano -> modeling_moss_tts_nano
- Fix stage config: is_comprehension=true (required for generate task)
- Fix default mode: voice_clone -> continuation (built-in presets)
- Add compute_logits stub for VllmModelForTextGeneration protocol
- Remove unused _sentinel nn.Parameter
- Add Gradio demo with AudioWorklet streaming player (48kHz stereo)
- Add online/offline serving docs and launch scripts
TODO: Single-stage generation models don't support true streaming
(progressive audio chunks). Current TTFP = full generation time.
Needs multi-step scheduling support in GPUGenerationModelRunner.
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-14 13:06:44 -04:00
Bvicii
4fb078a031
[Bugfix] Reject /v1/audio/speech for Qwen omni models ( #2763 )
...
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com >
2026-04-14 12:53:06 +00:00
Samit
644edac0b6
[Perf] Optimize MP4 encoding latency in video generation ( #2735 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-04-14 14:20:38 +08:00
14f7910900
[Perf]: Speedup VoxCPM2 TTS performance and Support PagedAttention ( #2690 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-14 09:16:47 +12:00
Reid and Hongsheng Liu
38dfe56fdf
[Bugfix] Validate speaker in chat endpoint and fix case-insensitive lookup ( #2407 )
...
Signed-off-by: reidliu41 <reid201711@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-12 00:14:16 -04:00
Juan Pablo Zuluaga
f7e8df9dbd
[TTS][OmniVoice] Add voice cloning support for OmniVoice TTS ( #2676 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com >
2026-04-11 12:14:03 -04:00
teith and Yueqian Lin
001f2e32e2
[BUG FIX]: prevent EngineCore crash when Qwen TTS Base task is missing ref_text ( #2203 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-11 02:46:38 +00:00
Nick Cao and Claude
2bc183f6f0
[Refactor] Remove dependency on librosa ( #2273 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-11 02:11:31 +08:00
bjf-frz
fbb5dd5794
[Bugfix]: modify diffusion pipeline profiler result in videos ( #2647 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
2026-04-10 16:48:06 +08:00
wuhang and Didan Deng
cb91cbe61e
[Entrypoint][Refactor]Stage CLI Refactor ( #2020 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-10 14:40:37 +08:00
Yueqian Lin
94232436bb
[Feat][FishSpeech] Cache DAC-encoded ref audio for voice cloning ( #2609 )
...
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-10 10:34:03 +08:00
Sy03
694be6f2e1
[Bugfix] Fix Fish Speech voice clone FileNotFoundError on multi-GPU ( #2606 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-04-09 20:34:34 +00:00
Ting FU
0e8e630c5b
[Feat] /v1/images/generations api supports request cancel ( #2621 )
...
Signed-off-by: Semmer <semmer@live.cn >
2026-04-09 07:08:08 +00:00
汪志鹏
9d87229a30
[MagiHuman] Fix audio sample rate and fps propagation for online serving ( #2554 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-04-09 06:52:12 +00:00
pjh4993
ed7a448cd3
[Bugfix] Guard app.state access during server shutdown ( #2587 )
...
Signed-off-by: pjh4993 <pjh4993@naver.com >
2026-04-09 14:41:23 +08:00
Nick Cao and Claude
3bd8a5239e
[Bugfix] Enforce --max-generated-image-size on /v1/images/generations ( #2599 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-09 03:54:12 +00:00
vveerrgg and vveerrgg
2c6c07c4f6
[TTS] Add missing _generate_pcm_chunks for OmniOpenAIServingSpeech streaming ( #2569 )
...
Signed-off-by: Yueqian Lin <pandaleefree@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: vveerrgg <vveerrgg@users.noreply.github.com >
2026-04-08 22:20:33 +00:00
Lancer
8609bc8ed9
[Feat] image2image for Z-Image ( #1580 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Lancer <402430575@qq.com >
2026-04-08 14:41:24 +08:00
Markus / Mark and marksverdhai
feefdaee9f
[Bugfix] Accept 'speaker' as alias for 'voice' in TTS speech API ( #2424 )
...
Signed-off-by: marksverdhei <marksverdhei@hotmail.com >
Signed-off-by: marksverdhai <249650165+marksverdhai@users.noreply.github.com >
Co-authored-by: marksverdhai <249650165+marksverdhai@users.noreply.github.com >
2026-04-07 15:07:01 +00:00
skf
9584dd6e69
[HunyuanImage3] Align system_prompt support with official implementation ( #2270 )
...
Signed-off-by: skf1999 <13234016272@163.com >
2026-04-07 15:37:17 +08:00
Bvicii
badbe8eb0f
[RFC] Offload blocking TTS/speech ops to thread pool to unblock event loop ( #2511 )
...
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com >
2026-04-07 00:17:04 -04:00