Alex Brooks b15d4e6a64 [Frontend] Implement Batched Chat Completions (#5317) ...

Signed-off-by: Alex Brooks <albrooks@redhat.com>

2026-08-07 16:12:09 -06:00

..

protocol

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

tts_adapters

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

__init__.py

[Core] Supports stage abstraction in the diffusion model (#391)

2025-12-27 01:59:33 +13:00

api_server.py

[Frontend] Implement Batched Chat Completions (#5317)

2026-08-07 16:12:09 -06:00

audio_utils_mixin.py

[Bugfix] Fix audio.format parameter silently ignored in chat completions (#4718)

2026-07-16 00:17:02 -06:00

batch_serving.py

[Frontend] Implement Batched Chat Completions (#5317)

2026-08-07 16:12:09 -06:00

diffusion_request_utils.py

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

duplex_capability.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

errors.py

[Frontend] Rewrite video API for async job lifecycle (#1665)

2026-03-13 17:11:06 +08:00

image_api_utils.py

[Bugfix] Match image file metadata to output format (#5619)

2026-08-01 15:09:27 +00:00

realtime_connection.py

[Bugfix][Realtime] Stop disconnected sessions from cycling through stages (#5388)

2026-07-27 17:04:17 +00:00

serving_audio_generate.py

[Rebase] Rebase to vllm v0.25.0 (#5042)

2026-07-12 23:39:53 +08:00

serving_chat.py

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

serving_speech_stream.py

[Feature] Flush the speech WebSocket on input.done without closing it (#5517)

2026-07-28 23:46:19 +00:00

serving_speech.py

[CI/Build][MiniCPM-o] Allow auto-response before input commit (#5567)

2026-07-30 14:14:19 +00:00

serving_video_output_stream.py

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

serving_video_stream.py

Refactor: extract OmniStreamingVideoHandler base and QwenOmniStreamingVideoHandler (#4424)

2026-06-17 15:07:45 +00:00

serving_video.py

[Model][Feat] Support Minimax-H3 quality grading requests through dynamic loading/unloading with Cache-DiT (#5853)

2026-08-07 09:07:23 +00:00

speech_usage.py

[Bugfix] Fix /v1/audio/speech usage token accounting for Qwen3-TTS (#4646) (#4673)

2026-06-27 06:13:31 +08:00

stage_params.py

[Refactor] Centralize stage sampling params resolution (#3153)

2026-04-26 23:30:11 +08:00

storage.py

[Frontend] Configurable video storage backends with TTL (#2531)

2026-06-19 17:41:22 -06:00

stores.py

[Frontend] Rewrite video API for async job lifecycle (#1665)

2026-03-13 17:11:06 +08:00

utils.py

[New Model]: Add sensenova u1 support (#3319)

2026-05-11 22:19:00 +08:00

video_api_utils.py

[Perf] Bound memory during video frame conversion (#5732)

2026-08-06 14:41:59 +08:00

video_frame_filter.py

[Feature] Streaming video input with EVS frame filtering (RFC #2201 Phase 2-4) (#2342)

2026-04-24 22:54:35 +08:00

video_stream_base.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

video_stream_context.py

[Feature] Streaming video input with EVS frame filtering (RFC #2201 Phase 2-4) (#2342)

2026-04-24 22:54:35 +08:00

video_stream_envs.py

[Feature] Streaming video input with EVS frame filtering (RFC #2201 Phase 2-4) (#2342)

2026-04-24 22:54:35 +08:00

video_stream_session.py

[Feature] Streaming video input with EVS frame filtering (RFC #2201 Phase 2-4) (#2342)

2026-04-24 22:54:35 +08:00