anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
26cf9ef4ed5fb161af6480474c62b457cd830fe0
vllm-omni/examples/offline_inference/tmp_test/ray_head.sh
T
wzliu 33e03b44c5 added omni mooncake connectors to distributed directory, integrate omni connector to omni-llm, rebased with main (twice). 
ray + mooncake connector work on 2 nodes, but needes several updates\n1.start ray inside vllm-omni \n2.placement group optimize \n3.fix close
2025-12-01 10:45:26 +08:00

2 lines
42 B
Bash
Raw Blame History

ray start --head --port=6399 --num-gpus=1
Reference in new issue View Git Blame Copy Permalink