 LHXuuuandHongsheng Liu
|
dff757da9c
|
[Perf][PrefixCache] Avoid per-step blocking write in OmniTensorPrefix… (#4106)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-06-17 16:53:47 +08:00 |
|
|
Juan Pablo ZuluagaandJuanPZuluaga
|
0342827dd7
|
[Bugfix] qwen3-tts prefix cache: drop per-key size cap that corrupted… (#4317)
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com>
|
2026-06-10 21:20:08 +08:00 |
|
|
|
57227dc7f3
|
[Perf][Bugfix] qwen3-tts hot path: prefix-cache OOM guards + talker/orchestrator micro-opts (#3689)
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-06-09 10:36:57 -07:00 |
|
|
Yueqian Lin
|
82cce633a3
|
[Perf][Higgs-Audio-V3] Turn on Stage-0 prefix caching by default (#4199)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-06-07 03:09:47 +00:00 |
|
|
TaffyOfficialandTaffyOfficial
|
ee33601571
|
[Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734)
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
|
2026-06-01 09:35:07 +00:00 |
|
|
Yueqian LinandRein Yang
|
e996723bc9
|
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness (#3665)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
the ci failure case is irrelavent to this PR and occurs rarely
|
2026-05-25 23:09:38 +08:00 |
|
|
Alex Brooks
|
f1e3f03726
|
[feature] Hidden State Prefix Caching (#2164)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-04-15 17:01:45 +00:00 |
|