275 B
275 B
Profiling vLLM-Omni
Profiling is only intended for vLLM-Omni developers and maintainers to understand the proportion of time spent in different parts of the codebase. vLLM-Omni end-users should never turn on profiling as it will significantly slow down the inference.