[Bugfix] Fix bug of online serving for qwen2.5-omni (#118)
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
This commit is contained in:
1 parent
0d110312df
commit
bfd3cad5ee
9 files changed
+50
-62
No files matched your search
@@ -32,11 +32,11 @@ def get_device_control_env_var() -> str:
|
||||
return "CUDA_VISIBLE_DEVICES" # fallback
|
||||
|
||||
|
||||
def get_diffusion_worker_class():
|
||||
def get_diffusion_worker_class() -> type:
|
||||
"""Get the appropriate diffusion WorkerProc class based on current device type.
|
||||
|
||||
Returns:
|
||||
The WorkerProc class for the detected device type.
|
||||
The WorkerProc class for the detected device type (either NPUWorkerProc or WorkerProc).
|
||||
|
||||
Raises:
|
||||
ImportError: If the worker module for the detected device is not available.
|
||||
|
||||
Reference in new issue
Block a user