4 lines
275 B
Markdown
4 lines
275 B
Markdown
# Profiling vLLM-Omni
|
|
|
|
Profiling is only intended for vLLM-Omni developers and maintainers to understand the proportion of time spent in different parts of the codebase. **vLLM-Omni end-users should never turn on profiling** as it will significantly slow down the inference.
|