Skip to content

fix(frontend): [release/1.6.0] require a servable model for readiness - #16943

Merged
nv-nmailhot merged 1 commit into
release/1.6.0from
bis/backport-16174-release-1.6.0
Oct 21, 2026
Merged

fix(frontend): [release/1.6.0] require a servable model for readiness#16943
nv-nmailhot merged 1 commit into
release/1.6.0from
bis/backport-16174-release-1.6.0

Conversation

@biswapanda

@biswapanda biswapanda commented Oct 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Refs DYN-5027.

Summary

Backport #16174 to release/1.6.0. Model-specific readiness requires ready topology, a usable engine, and enabled HTTP routes. Known but unready models return HTTP 503 with diagnostic JSON; operators select /v1/models/<model>/ready for readiness probes.

Refs #16253.

Clean cherry-pick of 938f4e438ed437a6e4ee1424d4ce4ae0af0d7160; no conflict resolution or extra prerequisites. The six-file patch is unchanged from the merged main fix.

Validation

  • Formatting, applicable repository pre-commit checks, and git diff --check pass.
  • Docs lint passes for both changed pages with zero errors.
  • Focused Rust validation did not execute tests: the test build reached linking, exhausted available disk, and failed. Task-generated build output was removed to restore disk capacity; release CI must validate the Rust readiness tests.
  • Full Fern validation is blocked by 26 existing missing generated API pages; no navigation or generated API content changed.
  • Signed commit includes DCO sign-off and source cherry-pick provenance.

@ritazh @biswapanda
fix(frontend): backport serving-aware model readiness
d585317 
Refs #16253

(cherry picked from commit 938f4e4)

Signed-off-by: Rita Zhang <1856066+ritazh@users.noreply.github.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
@biswapanda
biswapanda requested review from a team as code owners October 20, 2026 20:48
@biswapanda biswapanda added the cherry-pick:requested Fix requested for the release branch in code freeze label Oct 20, 2026
@biswapanda
biswapanda requested a review from a team as a code owner October 20, 2026 20:48
@github-actions github-actions Bot added the fix label Oct 20, 2026
@biswapanda

biswapanda commented Oct 20, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test d585317

@github-actions github-actions Bot added documentation Improvements or additions to documentation frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` labels Oct 20, 2026
@github-actions

github-actions Bot commented Oct 20, 2026

Copy link
Copy Markdown
Contributor

🌿 Fern Docs Preview: https://nvidia-preview-01a15b15-e10c-722d-812d-3a6941955755.docs.buildwithfern.com/dynamo/dev

@biswapanda biswapanda added cherry-pick:requested Fix requested for the release branch in code freeze and removed cherry-pick:requested Fix requested for the release branch in code freeze labels Oct 20, 2026
@nv-nmailhot
nv-nmailhot merged commit 5c85adc into release/1.6.0 Oct 21, 2026
190 of 193 checks passed
@nv-nmailhot
nv-nmailhot deleted the bis/backport-16174-release-1.6.0 branch October 21, 2026 00:17
@sttts sttts mentioned this pull request Nov 4, 2026
Open
11 of 71 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer
@dynamo-review-agent dynamo-review-agent[bot] dynamo-review-agent[bot] approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

cherry-pick:requested Fix requested for the release branch in code freeze documentation Improvements or additions to documentation fix frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` size/XL

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@biswapanda @nv-nmailhot @ritazh