This website requires JavaScript.
Explore
Help
Sign In
anodyine
/
vllm-omni
Watch
1
Star
0
Fork
0
Code
Issues
4
Pull Requests
2
Actions
Packages
Projects
Releases
Wiki
Activity
134
Commits
235
Branches
31
Tags
c10cbbd2ea63bdfb8c451d769a69a711c6ed0b33
Commit Graph
3 Commits
Include renames
Author
SHA1
Message
Date
tzhouam
13dfb56a68
Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.
...
Signed-off-by: 齐保元 <
qibaoyuan@xiaomi.com
>
2025-11-14 18:44:28 +08:00
tzhouam
6c6ff9f27c
Enhance error handling and logging in pipeline and stage processing. Added detailed logging for prompt loading failures, file writing issues, and stage shutdown processes. Introduced a new logging utility for orchestrator metrics and streamlined stats handling in the PipelinedOmniLLM class.
...
Signed-off-by: 齐保元 <
qibaoyuan@xiaomi.com
>
2025-11-14 18:44:28 +08:00
tzhouam
62b0e81795
Port changes from feat/multi-request-stream (vs main)
...
Signed-off-by: 齐保元 <
qibaoyuan@xiaomi.com
>
2025-11-14 18:44:28 +08:00