tzhouam 91c11c3ff4 Add AR GPU Model Runner and Worker ...

- Introduced ARModelRunner for autoregressive GPU model execution, enabling per-request hidden state outputs and token sampling.
- Added ARGPUWorker to initialize GPU settings and manage distributed environment for the AR model runner.
- Enhanced memory management and error handling for GPU resources during initialization.

2025-10-22 15:25:17 +08:00

..

config

update ar_dit_test

2025-09-28 21:58:48 +08:00

core

del unnessearcy files

2025-09-29 17:49:32 +08:00

distributed

update dirs

2025-09-11 15:56:28 +08:00

engine

fix diffusion engine

2025-09-28 22:09:13 +08:00

entrypoints

change omni.py to serve.py and mv to cli

2025-09-29 18:10:37 +08:00

model_executor

update ar_dit_test

2025-09-28 21:58:48 +08:00

sample

update dirs

2025-09-11 15:43:43 +08:00

utils

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

worker

Add AR GPU Model Runner and Worker

2025-10-22 15:25:17 +08:00

__init__.py

refactor: move omni_llm.py to entrypoints directory

2025-09-26 17:39:00 +08:00

request.py

init request.py

2025-09-15 22:46:40 +08:00