[Feat][Perf][AuK]Support Online Serving and DiT CUDAGraph (#7469)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com> Signed-off-by: Yueqian Lin <linyueqian@outlook.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
This commit is contained in:
22 files changed
+1473
-38
No files matched your search
@@ -1475,6 +1475,7 @@ class OnlineOmniClient:
|
||||
"max_new_tokens",
|
||||
"seed",
|
||||
"instructions",
|
||||
"duration_seconds",
|
||||
"speed",
|
||||
"sample_rate",
|
||||
"extra_params",
|
||||
|
||||
Reference in new issue
Block a user