Yueqian LinandSy0307
e788ef6e76
Signed-off-by: Yueqian Lin <linyueqian@outlook.com> Signed-off-by: Sy0307 <24841857+Sy0307@users.noreply.github.com> Co-authored-by: Sy0307 <24841857+Sy0307@users.noreply.github.com>
16 lines
593 B
Bash
Executable File
16 lines
593 B
Bash
Executable File
#!/bin/bash
|
|
# PersonaPlex full-duplex online serving.
|
|
#
|
|
# Serves the OFFICIAL PersonaPlex web client at / (auto-downloaded from
|
|
# nvidia/personaplex-7b-v1) and the Moshi WebSocket protocol at /api/chat,
|
|
# backed by the native vLLM-Omni engine. Requires HF access to the gated repo.
|
|
|
|
HOST="${HOST:-0.0.0.0}"
|
|
PORT="${PORT:-8124}"
|
|
|
|
echo "Starting PersonaPlex duplex server on ${HOST}:${PORT}..."
|
|
echo "Open http://localhost:${PORT}/ for the official web client (run it near the server)."
|
|
|
|
python -m vllm_omni.experimental.fullduplex.personaplex.serving.server \
|
|
--host "$HOST" --port "$PORT"
|