 wzliu
|
33e03b44c5
|
added omni mooncake connectors to distributed directory, integrate omni connector to omni-llm, rebased with main (twice).
ray + mooncake connector work on 2 nodes, but needes several updates\n1.start ray inside vllm-omni \n2.placement group optimize \n3.fix close
|
2025-12-01 10:45:26 +08:00 |
|