tzhouam 62dbf07fb6 Refactor OpenAI serving modules for improved functionality and organization ...

- Reintroduced the load_chat_template import in api_server.py for better template handling.
- Updated the logic in serving_chat.py to streamline the resolution of chat template content formats, enhancing clarity and functionality.
- Adjusted the application of chat templates to ensure proper handling of tools and chat templates.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-01-30 02:44:13 +00:00

..

cli

[Feature]: Add CFG param to online serving (#824)

2026-01-19 04:23:15 +00:00

openai

Refactor OpenAI serving modules for improved functionality and organization

2026-01-30 02:44:13 +00:00

__init__.py

[Core] Supports stage abstraction in the diffusion model (#391)

2025-12-27 01:59:33 +13:00

async_omni_diffusion.py

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)

2026-01-27 10:22:40 +08:00

async_omni_llm.py

Dev/rebase 0.14.0 (#847)

2026-01-21 00:25:25 +08:00

async_omni.py

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)

2026-01-27 10:22:40 +08:00

chat_utils.py

Refactor chat_utils and OpenAI modules for improved functionality and organization

2026-01-29 09:00:43 +00:00

client_request_state.py

[Bug fix] fix e2e_total_tokens and e2e_total_time_ms (#648)

2026-01-08 20:25:04 +08:00

log_utils.py

[Bug fix] fix e2e_total_tokens and e2e_total_time_ms (#648)

2026-01-08 20:25:04 +08:00

omni_diffusion.py

Support Bagel Model (#726)

2026-01-22 23:09:55 +13:00

omni_llm.py

Support Bagel Model (#726)

2026-01-22 23:09:55 +13:00

omni_stage.py

[Feature]Support async computation and communication across stages by chunks (#727)

2026-01-26 11:21:24 +08:00

omni.py

[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment (#758)

2026-01-27 10:22:40 +08:00

stage_utils.py

[Feature]Support async computation and communication across stages by chunks (#727)

2026-01-26 11:21:24 +08:00

utils.py

[Feature]Support async computation and communication across stages by chunks (#727)

2026-01-26 11:21:24 +08:00