Hongsheng LiuandWeiQing Chen
f22944eea4
Signed-off-by: hsliu <liuhongsheng4@huawei.com> Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
289 B
289 B
Profiling vLLM-Omni (update soon)
Profiling is only intended for vLLM-Omni developers and maintainers to understand the proportion of time spent in different parts of the codebase. vLLM-Omni end-users should never turn on profiling as it will significantly slow down the inference.