3 lines
289 B
Markdown
3 lines
289 B
Markdown
|
# Profiling vLLM-Omni (update soon)
|
||
|
|
|
||
|
|
Profiling is only intended for vLLM-Omni developers and maintainers to understand the proportion of time spent in different parts of the codebase. **vLLM-Omni end-users should never turn on profiling** as it will significantly slow down the inference.
|