4 Commits

Include renames

Author	SHA1	Message	Date
Gao Han	c5a89302f1	[Feature] Support online inference (#64) ... Signed-off-by: Gaohan123 <gaohan19@huawei.com>	2025-11-17 14:44:10 +08:00
tzhouam	26fcae5def	Debug and Update doc ... Signed-off-by: tzhouam <tzhouam@connect.ust.hk>	2025-11-11 14:49:45 +08:00
tzhouam	8e8783d78a	Refactor end-to-end inference script and enhance argument parsing. Added support for loading prompts from a .pt file, introduced new command-line arguments for initialization and output handling, and improved error handling for prompt loading. Removed deprecated files related to previous implementations.	2025-11-10 11:58:47 +08:00
tzhouam	c5631ca753	Enhance error handling and logging in pipeline and stage processing. Added detailed logging for prompt loading failures, file writing issues, and stage shutdown processes. Introduced a new logging utility for orchestrator metrics and streamlined stats handling in the PipelinedOmniLLM class.	2025-11-07 18:05:00 +08:00