tzhouam 36ada0478a add back the sleep time for the stage init to avoid single card conflict ...

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2025-11-10 15:07:01 +08:00

..

cli

Remove unused files and fix some bugs

2025-10-25 18:02:11 +08:00

__init__.py

update config and entrypoints

2025-09-11 16:15:48 +08:00

log_utils.py

Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.

2025-11-10 11:58:47 +08:00

omni_llm.py

add back the sleep time for the stage init to avoid single card conflict

2025-11-10 15:07:01 +08:00

omni_stage.py

Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.

2025-11-10 11:58:47 +08:00

pipeline_utils.py

Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.

2025-11-10 11:58:47 +08:00

utils.py

Dependency refractored to vLLM v0.11.0

2025-11-04 22:06:41 +08:00