tzhouamandClaude Opus 4.8
7e7b99b60f
Build #2233 on the vllm-omni-rebase pipeline failed both "Upload Ready Pipeline" and "Upload Merge Pipeline" with: Pipeline upload rejected: `source_file_dependencies` is not a valid property on the `command` step. `source_file_dependencies` is an uploader-only key understood by upload_pipeline.py, not by Buildkite. #4478 switched the rebase pipeline's Ready/Merge steps to raw `buildkite-agent pipeline upload` to run the full e2e suite (bypassing diff-aware skipping), but that also bypassed the key-stripping, so Buildkite rejected the YAML. Add a `--all` flag to upload_pipeline.py that forces the keep-all-steps path (changed_files=None) while still stripping source_file_dependencies, and use it for the rebase pipeline's Ready/Merge (and Nightly) uploads. This restores a valid upload AND retains running the full e2e suite on main builds. Normal-CI .buildkite/pipeline.yml is unchanged (still diff-aware). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
39 lines
1.3 KiB
YAML
39 lines
1.3 KiB
YAML
steps:
|
|
- label: ":docker: Build image"
|
|
key: image-build
|
|
commands:
|
|
- "aws ecr-public get-login-password --region us-east-1 | docker login --username AWS --password-stdin public.ecr.aws/q9t5s3a7"
|
|
- "docker build --progress=plain --file docker/Dockerfile.ci -t vllm-omni-ci ."
|
|
- "docker tag vllm-omni-ci public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:$BUILDKITE_COMMIT"
|
|
- "docker push public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:$BUILDKITE_COMMIT"
|
|
agents:
|
|
queue: "cpu_queue_premerge"
|
|
|
|
# L2 Test
|
|
- label: "Upload Ready Pipeline"
|
|
depends_on: image-build
|
|
key: upload-ready-pipeline
|
|
commands:
|
|
- python3 .buildkite/scripts/upload_pipeline.py --upload --all .buildkite/test-ready.yml
|
|
agents:
|
|
queue: "cpu_queue_premerge"
|
|
|
|
# L3 Test
|
|
- label: "Upload Merge Pipeline"
|
|
depends_on: image-build
|
|
key: upload-merge-pipeline
|
|
commands:
|
|
- python3 .buildkite/scripts/upload_pipeline.py --upload --all .buildkite/test-merge.yml
|
|
agents:
|
|
queue: "cpu_queue_premerge"
|
|
|
|
# L4 Test
|
|
- label: "Upload Nightly Pipeline"
|
|
depends_on: image-build
|
|
key: upload-nightly-pipeline
|
|
if: build.env("NIGHTLY") == "1"
|
|
commands:
|
|
- python3 .buildkite/scripts/upload_pipeline.py --upload --all .buildkite/test-nightly.yml
|
|
agents:
|
|
queue: "cpu_queue_premerge"
|