tzhouam
478c036a01
- Refactored import statements in api_server.py to enhance module organization, including changes to the routing and server setup. - Updated the method for removing routes to ensure compatibility with the new app structure. - Adjusted the handling of chat completion requests to improve error responses and streamline processing. - Modified serving modules to align with the new import paths and enhance code clarity. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
6 lines
196 B
Python
6 lines
196 B
Python
from vllm.entrypoints.openai.chat_completion.protocol import ChatCompletionStreamResponse
|
|
|
|
|
|
class OmniChatCompletionStreamResponse(ChatCompletionStreamResponse):
|
|
modality: str | None = "text"
|