Hongsheng LiuandWeiQing Chen
f22944eea4
Signed-off-by: hsliu <liuhongsheng4@huawei.com> Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
4 lines
289 B
Markdown
4 lines
289 B
Markdown
# Profiling vLLM-Omni (update soon)
|
|
|
|
Profiling is only intended for vLLM-Omni developers and maintainers to understand the proportion of time spent in different parts of the codebase. **vLLM-Omni end-users should never turn on profiling** as it will significantly slow down the inference.
|