Commit Graph
4 Commits
Author SHA1 Message Date
Gaohan123 171f3c1ea7 fix conflicts 2025-10-24 16:49:19 +08:00
tzhouam 28ae542eed match runner, worker name with file name 2025-10-23 14:35:23 +08:00
tzhouam 53b86439fc Refactor ARModelRunner to streamline hidden state handling
- Removed unnecessary imports of numpy and torch within the request scheduling logic.
- Simplified the handling of auxiliary hidden states by initializing it to None when not present.
- Optimized CPU tensor conversion for text hidden states to improve performance.
2025-10-22 17:16:15 +08:00
tzhouam 6d04ea8450 rename to gpu-xx-model-runner style 2025-10-22 15:28:23 +08:00