[Model] Add native MAGI-2 Preview diffusion support (#5918)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com> Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
This commit is contained in:
1 parent
13c617a140
commit
d4096e01fe
78 files changed
+9896
-459
No files matched your search
+40
-36
@@ -1,6 +1,10 @@
|
||||
# Recipe Title
|
||||
# Recipe Title — Hardware
|
||||
|
||||
> Example: Qwen3-Omni for speech chat
|
||||
> Example: Qwen3-Omni for speech chat — H100
|
||||
|
||||
Name the file `recipes/<vendor>/<model>-<hardware>.md`. Keep exactly one
|
||||
hardware profile in each recipe; add a separate suffixed recipe when another
|
||||
accelerator is qualified.
|
||||
|
||||
## Summary
|
||||
|
||||
@@ -8,28 +12,44 @@
|
||||
- Model:
|
||||
- Task:
|
||||
- Mode:
|
||||
- Hardware:
|
||||
- Maintainer:
|
||||
|
||||
## When to use this recipe
|
||||
|
||||
Briefly describe the concrete scenario this recipe covers.
|
||||
|
||||
## Supported model contract
|
||||
|
||||
Put user-visible constraints before commands. Use compact tables for:
|
||||
|
||||
- supported tasks and shared entrypoints;
|
||||
- input modalities, counts, duration/geometry limits, and required combinations;
|
||||
- output duration, geometry, frame/audio rates, and variants;
|
||||
- the deployment profiles provided on this recipe's named hardware.
|
||||
|
||||
Source model specifications from the canonical model card or repository. Do
|
||||
not copy values from a sibling model or infer support from configuration alone.
|
||||
|
||||
## References
|
||||
|
||||
- Upstream or canonical docs:
|
||||
- Related example under `examples/`:
|
||||
- Related issue or discussion:
|
||||
|
||||
## Hardware Support
|
||||
## Hardware
|
||||
|
||||
Add one section per platform, such as `GPU`, `ROCm`, or `NPU`. Under each
|
||||
platform section, document one or more tested hardware configurations.
|
||||
- Accelerator model and per-device memory:
|
||||
- Number of devices:
|
||||
- Device interconnect (NVLink, PCIe, or other):
|
||||
- Host memory, when CPU offload or staging is relevant:
|
||||
- Qualification scope:
|
||||
|
||||
## GPU
|
||||
Do not add a second accelerator to this file. Create another
|
||||
`<model>-<hardware>.md` recipe instead. Mention unqualified upstream hardware
|
||||
only as a limitation, not as a provided profile.
|
||||
|
||||
### 1x A100 80GB
|
||||
|
||||
#### Environment
|
||||
## Software environment
|
||||
|
||||
- OS:
|
||||
- Python:
|
||||
@@ -37,7 +57,10 @@ platform section, document one or more tested hardware configurations.
|
||||
- vLLM version:
|
||||
- vLLM-Omni version or commit:
|
||||
|
||||
#### Command
|
||||
Keep worker counts, precision, and TP/SP/DP/PP sizes with the command or
|
||||
deployment profile; they are not software-environment properties.
|
||||
|
||||
## Command
|
||||
|
||||
Serve commands use `vllm serve <model> --omni`. The `--omni` flag is what
|
||||
selects the Omni pipeline, so it is required and cannot be dropped.
|
||||
@@ -46,40 +69,21 @@ selects the Omni pipeline, so it is required and cannot be dropped.
|
||||
# Add the exact command(s) here
|
||||
```
|
||||
|
||||
#### Verification
|
||||
## Verification
|
||||
|
||||
```bash
|
||||
# Add a quick validation command or expected output here
|
||||
```
|
||||
|
||||
#### Notes
|
||||
## Notes
|
||||
|
||||
- Memory usage:
|
||||
- Key flags:
|
||||
- Known limitations:
|
||||
|
||||
### 2x L40S
|
||||
## Supported features
|
||||
|
||||
Repeat the same structure for other hardware setups as needed.
|
||||
|
||||
## ROCm
|
||||
|
||||
### Example hardware configuration
|
||||
|
||||
Repeat the same nested structure for ROCm setups as needed:
|
||||
|
||||
- `#### Environment`
|
||||
- `#### Command`
|
||||
- `#### Verification`
|
||||
- `#### Notes`
|
||||
|
||||
## NPU
|
||||
|
||||
### Example hardware configuration
|
||||
|
||||
Repeat the same nested structure for NPU setups as needed:
|
||||
|
||||
- `#### Environment`
|
||||
- `#### Command`
|
||||
- `#### Verification`
|
||||
- `#### Notes`
|
||||
Use a compact table containing the model-specific status/topology and a link to
|
||||
the corresponding shared feature guide. Do not repeat the general feature
|
||||
documentation in the recipe. Record unsupported combinations in the same table
|
||||
instead of a disconnected restrictions section.
|
||||
Reference in new issue
Block a user