anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
26cf9ef4ed5fb161af6480474c62b457cd830fe0
vllm-omni/examples/offline_inference/tmp_test/ray_worker.sh
T
wzliu 33e03b44c5 added omni mooncake connectors to distributed directory, integrate omni connector to omni-llm, rebased with main (twice). 
ray + mooncake connector work on 2 nodes, but needes several updates\n1.start ray inside vllm-omni \n2.placement group optimize \n3.fix close
2025-12-01 10:45:26 +08:00

2 lines
37 B
Bash
Raw Blame History

ray start --address=10.90.67.86:6399
Reference in new issue View Git Blame Copy Permalink