7bfd3c069d
Signed-off-by: wangyu31577 <wangyu31577@hundsun.com> Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com> Co-authored-by: wangyu31577 <wangyu31577@hundsun.com> Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
10 lines
197 B
Python
10 lines
197 B
Python
import argparse
|
|
import asyncio
|
|
from typing import Any
|
|
|
|
from vllm.benchmarks.serve import main_async
|
|
|
|
|
|
def main(args: argparse.Namespace) -> dict[str, Any]:
|
|
return asyncio.run(main_async(args))
|