Update docs/architecture/detailed arch design.md
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
1 parent
91f60bee94
commit
ffeb0dc407
1 file changed
+1
-1
@@ -206,7 +206,7 @@ dit_stage_config.executor_class = DiffusersPipelineExecutor
|
|||||||
|
|
||||||
Similar to OmniLLM in offline inference, add some asynchronous processing, referring to AsyncLLM
|
Similar to OmniLLM in offline inference, add some asynchronous processing, referring to AsyncLLM
|
||||||
```python
|
```python
|
||||||
from vllm.v1.engine.async_llm improt AsyncLLM
|
from vllm.v1.engine.async_llm import AsyncLLM
|
||||||
|
|
||||||
|
|
||||||
class AsyncOmniLLM(AsyncLLM):
|
class AsyncOmniLLM(AsyncLLM):
|
||||||
|
|||||||
Reference in new issue
Block a user