anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
0df8e805740e95272dc764dfd457a4d3260c55e2
vllm-omni/docs/api/README.md
T

122 lines
6.4 KiB
Markdown
Raw Normal View History

[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
# Summary
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
## Entry Points
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
Main entry points for vLLM-Omni inference and serving.
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
[Feat] Rename AsyncOmniLLM -> AsyncOmni (#103)
2025-11-30 22:26:33 +08:00
- [vllm_omni.entrypoints.async_omni.AsyncOmni][]
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.entrypoints.async_omni_diffusion.AsyncOmniDiffusion][]
[Core] Supports stage abstraction in the diffusion model (#391)
2025-12-26 20:59:33 +08:00
- [vllm_omni.entrypoints.async_omni_llm.AsyncOmniLLM][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.entrypoints.chat_utils.OmniAsyncMultiModalContentParser][]
- [vllm_omni.entrypoints.chat_utils.OmniAsyncMultiModalItemTracker][]
- [vllm_omni.entrypoints.chat_utils.parse_chat_messages_futures][]
- [vllm_omni.entrypoints.cli.serve.OmniServeCommand][]
[Feature] Support output modalities control per request (#298)
2025-12-17 17:19:56 +08:00
- [vllm_omni.entrypoints.client_request_state.ClientRequestState][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.entrypoints.log_utils.OrchestratorMetrics][]
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.entrypoints.log_utils.StageRequestMetrics][]
- [vllm_omni.entrypoints.log_utils.StageStats][]
[diffusion] add doc and fix qwen-image (#96)
2025-11-28 18:07:44 +08:00
- [vllm_omni.entrypoints.omni.Omni][]
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.entrypoints.omni.OmniBase][]
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
- [vllm_omni.entrypoints.omni_diffusion.OmniDiffusion][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.entrypoints.omni_llm.OmniLLM][]
- [vllm_omni.entrypoints.omni_stage.OmniStage][]
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.entrypoints.stage_utils.OmniStageTaskType][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
## Inputs
Input data structures for multi-modal inputs.
- [vllm_omni.inputs.data.OmniEmbedsPrompt][]
- [vllm_omni.inputs.data.OmniTokenInputs][]
- [vllm_omni.inputs.data.OmniTokensPrompt][]
- [vllm_omni.inputs.parse.parse_singleton_prompt_omni][]
- [vllm_omni.inputs.preprocess.OmniInputPreprocessor][]
## Engine
Engine classes for offline and online inference.
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.diffusion.diffusion_engine.BackgroundResources][]
[diffusion] add doc and fix qwen-image (#96)
2025-11-28 18:07:44 +08:00
- [vllm_omni.diffusion.diffusion_engine.DiffusionEngine][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.engine.AdditionalInformationEntry][]
- [vllm_omni.engine.AdditionalInformationPayload][]
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs (#113)
2025-11-30 18:20:44 +08:00
- [vllm_omni.engine.OmniEngineCoreOutput][]
- [vllm_omni.engine.OmniEngineCoreOutputs][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.engine.OmniEngineCoreRequest][]
- [vllm_omni.engine.PromptEmbedsPayload][]
- [vllm_omni.engine.arg_utils.AsyncOmniEngineArgs][]
- [vllm_omni.engine.arg_utils.OmniEngineArgs][]
[Doc] Refine the document. (#403)
2025-12-22 21:29:40 +08:00
- [vllm_omni.engine.input_processor.OmniInputProcessor][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.engine.output_processor.MultimodalOutputProcessor][]
- [vllm_omni.engine.output_processor.OmniRequestState][]
## Core
Core scheduling and caching components.
[Bugfix] Fix ci bug for qwen2.5-omni (#230)
2025-12-08 02:43:48 +08:00
- [vllm_omni.core.sched.omni_ar_scheduler.OmniARScheduler][]
- [vllm_omni.core.sched.omni_generation_scheduler.OmniGenerationScheduler][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.core.sched.output.OmniNewRequestData][]
## Model Executor
Model execution components.
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.model_executor.custom_process_mixin.CustomProcessMixin][]
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs (#113)
2025-11-30 18:20:44 +08:00
- [vllm_omni.model_executor.models.output_templates.OmniOutput][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni.Qwen2_5OmniForConditionalGeneration][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_talker.Qwen2_5OmniTalkerForConditionalGeneration][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_thinker.Qwen2_5OmniConditionalGenerationMixin][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_thinker.Qwen2_5OmniThinkerForConditionalGeneration][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_token2wav.Qwen2_5OmniToken2WavBigVGANModel][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_token2wav.Qwen2_5OmniToken2WavDiTModel][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_token2wav.Qwen2_5OmniToken2WavForConditionalGenerationVLLM][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_5_omni_token2wav.Qwen2_5OmniToken2WavModel][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_old.Qwen2EmbeddingModel][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_old.Qwen2ForCausalLM][]
- [vllm_omni.model_executor.models.qwen2_5_omni.qwen2_old.Qwen2Model][]
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs (#113)
2025-11-30 18:20:44 +08:00
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_moe.Qwen3MoeForCausalLM][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni.Qwen3OmniMoeForConditionalGeneration][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_code2wav.Qwen3OmniMoeCode2Wav][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_code_predictor_mtp.Qwen3OmniCodePredictorBaseModel][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_code_predictor_mtp.Qwen3OmniMoeTalkerCodePredictor][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_talker.Qwen3OmniMoeModel][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_talker.Qwen3OmniMoeTalkerForConditionalGeneration][]
[Doc] refactor diffusion doc (#753)
2026-01-13 19:21:24 +08:00
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_talker.Qwen3OmniMoeTalkerSharedExpertWrapper][]
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs (#113)
2025-11-30 18:20:44 +08:00
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3MoeLLMForCausalLM][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3MoeLLMModel][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3OmniMoeConditionalGenerationMixin][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3OmniMoeThinkerForConditionalGeneration][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3OmniMoeThinkerMultiModalProcessor][]
- [vllm_omni.model_executor.models.qwen3_omni.qwen3_omni_moe_thinker.Qwen3OmniMoeThinkerProcessingInfo][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
## Configuration
Configuration classes.
- [vllm_omni.config.model.OmniModelConfig][]
- [vllm_omni.diffusion.cache.teacache.config.TeaCacheConfig][]
- [vllm_omni.distributed.omni_connectors.utils.config.ConnectorSpec][]
- [vllm_omni.distributed.omni_connectors.utils.config.OmniTransferConfig][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
## Workers
Worker classes and model runners for distributed inference.
[Core]Add GPU Diffusion Runner (#822)
2026-01-17 19:49:13 +08:00
- [vllm_omni.diffusion.worker.gpu_diffusion_model_runner.GPUDiffusionModelRunner][]
- [vllm_omni.diffusion.worker.gpu_diffusion_worker.GPUDiffusionWorker][]
- [vllm_omni.diffusion.worker.gpu_diffusion_worker.WorkerProc][]
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
- [vllm_omni.diffusion.worker.npu.npu_worker.NPUWorker][]
- [vllm_omni.diffusion.worker.npu.npu_worker.NPUWorkerProc][]
[Doc] Refine the document. (#403)
2025-12-22 21:29:40 +08:00
- [vllm_omni.worker.gpu_ar_model_runner.ExecuteModelState][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.worker.gpu_ar_model_runner.GPUARModelRunner][]
- [vllm_omni.worker.gpu_ar_worker.GPUARWorker][]
[Bugfix] Remove mandatory flash-attn dependency and optimzie docs (#113)
2025-11-30 18:20:44 +08:00
- [vllm_omni.worker.gpu_generation_model_runner.GPUGenerationModelRunner][]
- [vllm_omni.worker.gpu_generation_worker.GPUGenerationWorker][]
[Docs] optimize and supplement docs system (#86)
2025-11-28 11:03:52 +08:00
- [vllm_omni.worker.gpu_model_runner.OmniGPUModelRunner][]
[Feature]Basic version of supporting streaming output (#367)
2025-12-31 22:02:04 +08:00
- [vllm_omni.worker.npu.npu_ar_model_runner.ExecuteModelState][]
[Misc] Fix docs and update image edit example with cache-dit (#318)
2025-12-15 21:43:28 +08:00
- [vllm_omni.worker.npu.npu_ar_model_runner.NPUARModelRunner][]
- [vllm_omni.worker.npu.npu_ar_worker.NPUARWorker][]
- [vllm_omni.worker.npu.npu_generation_model_runner.NPUGenerationModelRunner][]
- [vllm_omni.worker.npu.npu_generation_worker.NPUGenerationWorker][]
- [vllm_omni.worker.npu.npu_model_runner.OmniNPUModelRunner][]
Reference in new issue Copy Permalink