Update docs/architecture/detailed arch design.md
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
1 parent
91f60bee94
commit
ffeb0dc407
1 file changed
+1
-1
@@ -206,7 +206,7 @@ dit_stage_config.executor_class = DiffusersPipelineExecutor
|
||||
|
||||
Similar to OmniLLM in offline inference, add some asynchronous processing, referring to AsyncLLM
|
||||
```python
|
||||
from vllm.v1.engine.async_llm improt AsyncLLM
|
||||
from vllm.v1.engine.async_llm import AsyncLLM
|
||||
|
||||
|
||||
class AsyncOmniLLM(AsyncLLM):
|
||||
|
||||
Reference in new issue
Block a user