Skip to content

fix(inference): strip provider marker from URL requests - #7546

Merged
cv merged 2 commits into
mainfrom
codex/fix-url-provider-marker
Jul 26, 2026
Merged

cv merged 2 commits into
mainfrom
codex/fix-url-provider-marker

Conversation

@jyaunches

@jyaunches jyaunches commented Jul 26, 2026 •

Copy link
Copy Markdown
Contributor

Summary

URL-form Node.js HTTP requests now remove NemoClaw's internal upstream-provider marker before forwarding. Object-form requests and fetch already removed this routing metadata; this closes the remaining egress gap identified after #7485.

Related Issue

Follow-up to #7485, which fixed #6913.

Changes

  • Detect string-URL and URL-object forms of http.request and https.request.
  • Remove X-NemoClaw-Upstream-Provider from the created request while preserving other headers and original request arguments.
  • Add regression coverage for both URL forms and both Node.js transports.

Type of Change

  • Code change (feature, bug fix, or refactor)
  • Code change with doc updates
  • Doc only (prose changes, no code sample modifications)
  • Doc only (includes code sample changes)

Quality Gates

  • Tests added or updated for changed behavior
  • Existing tests cover changed behavior β€” justification:
  • Tests not applicable β€” justification:
  • Docs updated for user-facing behavior changes
  • Docs not applicable β€” justification: This removes internal routing metadata and changes no command, user configuration, setup flow, policy schema, or documented workflow.
  • Sensitive paths changed (security, policy, credentials, preflight, onboarding, inference, runner, sandbox, or messaging)
  • Sensitive-path review completed or maintainer-approved waiver recorded β€” reviewer/approval link/justification: Pending human review of this focused follow-up to fix(inference): strip thinking for Nemotron-3 modelsΒ #7485.
  • Non-success, skipped, or missing CI check accepted by maintainer β€” check name, approval link, and follow-up issue:

Documentation Writer Review

  • Documentation writer subagent reviewed the completed changes
  • Result: no-docs-needed
  • Evidence: nemoclaw-blueprint/scripts/nemotron-inference-fix.js removes the internal provider marker from URL-form Node.js HTTP requests. This changes no command, user configuration, setup flow, policy schema, or documented workflow. npx vitest run test/nemotron-inference-fix.test.ts passed 8 tests on PR SHA 95cd894db; the URL-form regression now inspects real Node HTTP/HTTPS ClientRequest headers while remaining offline.
  • Agent: Codex Desktop

DGX Station Hardware Evidence

  • Tested on DGX Station
  • Tested commit: Not applicable
  • Station profile/scenario: Not applicable
  • Result: Not applicable
  • Supporting evidence: Not applicable; this PR does not change scripts/prepare-dgx-station-host.sh.

Verification

  • PR description includes a Signed-off-by: line and every commit appears as Verified in GitHub
  • Normal pre-commit, commit-msg, and pre-push hooks passed, or npm run check:diff passed when hooks were skipped or unavailable
  • Targeted behavior tests pass for the current change set, or tests are marked not applicable above β€” command/result or justification: npx vitest run test/nemotron-inference-fix.test.ts passed 8/8; git diff --check passed.
  • Applicable broad gate passed β€” npm test for broad runtime/test-harness changes; npm run check for repo-wide validation/coverage changes β€” command/result: Not applicable; this is a focused transport compatibility fix.
  • Quality Gates section completed with required justifications or waivers
  • No secrets, API keys, or credentials committed
  • npm run docs builds without warnings (doc changes only)
  • Doc pages follow the style guide (doc changes only)
  • New doc pages include SPDX header and frontmatter (new pages only)

Signed-off-by: Julie Yaunches jyaunches@nvidia.com

Summary by CodeRabbit

  • Bug Fixes
    • Improved handling of HTTP/HTTPS requests made using URL strings or URL objects.
    • Removed the runtime upstream provider marker header case-insensitively, while preserving unrelated headers.
    • URL-form requests now reliably avoid unintended interception, preserving prior pass-through behavior when options aren’t applicable.
  • Tests
    • Added a Vitest coverage to validate header behavior for both http URL strings and https URL objects using the β€œNEMOTRON_FIX” preload.

Signed-off-by: Julie Yaunches <jyaunches@nvidia.com>
@coderabbitai

coderabbitai Bot commented Jul 26, 2026 •

Copy link
Copy Markdown
Contributor

Review Change Stack

πŸ“ Walkthrough

Walkthrough

The request wrapper now distinguishes URL-form inputs, normalizes their options, removes the runtime provider marker, and skips chat-completions interception. Tests cover HTTP and HTTPS URL-form requests with case-insensitive headers.

Changes

URL-form request handling

Layer / File(s) Summary
Normalize and validate URL-form requests
nemoclaw-blueprint/scripts/nemotron-inference-fix.js, test/nemotron-inference-fix.test.ts
The preload normalizes request options, removes x-nemoclaw-upstream-provider, preserves unrelated headers, and limits chat-completions interception to object-form requests. Tests cover string and URL inputs for HTTP and HTTPS.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

  • NVIDIA/NemoClaw#7485: Both changes update provider-marker handling in the Nemotron inference request interception flow.
πŸš₯ Pre-merge checks | βœ… 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Linked Issues check ⚠️ Warning The PR removes a URL-form header marker but does not address the linked issue's unsupported thinking-parameter request shape fix. Add the requested nemotron-3-ultra request-shape fix so NVIDIA Endpoints no longer receive the unsupported thinking parameter.
βœ… Passed checks (4 passed)
Check name Status Explanation
Out of Scope Changes check βœ… Passed The changes stay focused on URL-form request handling and regression coverage, with no obvious unrelated scope creep.
Docstring Coverage βœ… Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description Check βœ… Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check βœ… Passed The title clearly matches the main change: removing the provider marker from URL-form requests in inference plumbing.
✨ Finishing Touches
πŸ“ Generate docstrings
  • Create stacked PR
  • Commit on current branch
πŸ§ͺ Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/fix-url-provider-marker

Comment @coderabbitai help to get the list of available commands.

@github-code-quality

github-code-quality Bot commented Jul 26, 2026 •

Copy link
Copy Markdown
Contributor

Code Coverage Overview

Languages: TypeScript

TypeScript / code-coverage/plugin

The overall coverage in commit 95cd894 in the codex/fix-url-provid... branch remains at 96%, unchanged from commit 1895f14 in the main branch.

TypeScript / code-coverage/cli

The overall coverage in commit 95cd894 in the codex/fix-url-provid... branch is 80%. The coverage in commit 3e54a83 in the main branch is 81%.

Show a code coverage summary of the most impacted files.
File main 3e54a83 codex/fix-url-provid... 95cd894 +/-
src/lib/onboard/docker-cdi.ts 80% 70% -10%
src/lib/shields/index.ts 72% 67% -5%
src/lib/onboard...e-patch-flow.ts 76% 71% -5%
src/lib/onboard...host-anchors.ts 94% 90% -4%
src/lib/onboard/preflight.ts 77% 78% +1%
src/lib/actions...light-guards.ts 86% 90% +4%
src/lib/onboard...box-gpu-mode.ts 92% 97% +5%
src/lib/actions...confirmation.ts 69% 79% +10%
src/lib/actions...ocker-health.ts 65% 82% +17%
src/lib/onboard...box-prebuild.ts 74% 92% +18%

Updated July 26, 2026 01:28 UTC

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
test/nemotron-inference-fix.test.ts (1)

312-368: 🎯 Functional Correctness | πŸ”΅ Trivial | ⚑ Quick win

Assert headers through a real ClientRequest.

The harness reimplements removeHeader, so this only verifies the wrapper calls the fake methodβ€”not that Node’s actual request headers omit the marker. Use real local HTTP/HTTPS requests and inspect their headers before aborting, while keeping the test offline. As per path instructions, prefer observable outcomes through the public boundary over mock-call assertions.

πŸ€– Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@test/nemotron-inference-fix.test.ts` around lines 312 - 368, Update the
β€œpreload removes the runtime provider marker from URL-form Node requests
(`#6913`)” test to use real local HTTP and HTTPS server requests instead of
stubbed http.request/https.request methods. Inspect each actual ClientRequest’s
headers before aborting, assert the provider marker is absent while X-Keep
remains, and keep the test fully offline; remove assertions based on the fake
removeHeader call records.

Source: Path instructions

πŸ€– Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@test/nemotron-inference-fix.test.ts`:
- Around line 312-368: Update the β€œpreload removes the runtime provider marker
from URL-form Node requests (`#6913`)” test to use real local HTTP and HTTPS
server requests instead of stubbed http.request/https.request methods. Inspect
each actual ClientRequest’s headers before aborting, assert the provider marker
is absent while X-Keep remains, and keep the test fully offline; remove
assertions based on the fake removeHeader call records.

ℹ️ Review info
βš™οΈ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 0aa01050-1b97-4c8d-ae26-a1a477c6d7ed

πŸ“₯ Commits

Reviewing files that changed from the base of the PR and between f3127e0 and 530f7bf.

πŸ“’ Files selected for processing (2)
  • nemoclaw-blueprint/scripts/nemotron-inference-fix.js
  • test/nemotron-inference-fix.test.ts

@github-actions

github-actions Bot commented Jul 26, 2026 •

Copy link
Copy Markdown
Contributor

PR Review Advisor β€” No blocking findings reported

Advisor assessment: No blocking advisor findings reported
Next action: No advisor follow-up needed.
Findings: 0 blockers Β· 0 warnings Β· 0 suggestions

Model lanes

  • GPT-5.6 Terra (primary): Completed Β· high confidence Β· 0 blockers Β· 0 warnings Β· 0 suggestions
  • Nemotron 3 Ultra (second opinion): Completed Β· high confidence Β· 0 blockers Β· 0 warnings Β· 0 suggestions
  • Model comparison: normalized findings match; normalized E2E selections match; severity counts match.

Nemotron output stays in workflow artifacts and does not change the assessment above.

E2E guidance

Advisory only. E2E / PR Gate selects and runs jobs independently.

Recommended E2E: inference-routing, network-policy

1 optional E2E recommendation
  • openclaw-inference-switch

Workflow run details

This automated review informs maintainers. Warnings and suggestions do not require a response. A maintainer decides whether to merge.

Signed-off-by: Julie Yaunches <jyaunches@nvidia.com>

@apurvvkumaria apurvvkumaria left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Exact head 95cd894 is merge-ready: required CI and E2E pass, both advisor lanes report high-confidence zero findings, the valid ClientRequest test feedback is addressed, and no review threads remain. Trivial linked-issue bookkeeping can fix forward.

@cv
cv merged commit 0c57816 into main Jul 26, 2026
111 of 118 checks passed
@cv
cv deleted the codex/fix-url-provider-marker branch July 26, 2026 01:47
@cv cv mentioned this pull request Jul 26, 2026
10 of 23 tasks
apurvvkumaria pushed a commit that referenced this pull request Jul 27, 2026
<!-- markdownlint-disable MD041 -->
## Summary

Add the canonical `docs/changelog/2026-07-25.mdx` release entry with the
exact `## v0.0.96` heading.
The entry reconciles all 90 first-parent commits since v0.0.95 with all
92 merged PRs in the live `v0.0.96` label ledger and groups the
user-visible changes by operator journey.

## Changes

- Add the parser-safe dated MDX changelog entry for v0.0.96 with
root-absolute links to the focused user guides.
- Source summary:
- [#7194](#7194) ->
`docs/changelog/2026-07-25.mdx`: Document persistent baseline network
policy exclusions and their inspection, rebuild, and snapshot behavior.
- [#7188](#7188),
[#7427](#7427), and
[#7546](#7546) ->
`docs/changelog/2026-07-25.mdx`: Document DNS-backed HTTPS inference
routing, keyless loopback endpoints, and provider-marker isolation.
- [#7238](#7238) ->
`docs/changelog/2026-07-25.mdx`: Document blueprint sandbox and provider
identifier validation before state writes or OpenShell calls, with
bounded terminal-safe rejection previews.
- [#7319](#7319),
[#7274](#7274),
[#7528](#7528),
[#7353](#7353), and
[#7560](#7560) ->
`docs/changelog/2026-07-25.mdx`: Document the managed default gateway
service, onboarding readiness, and container-runtime identity
safeguards.
- [#7349](#7349),
[#7498](#7498),
[#7406](#7406),
[#7196](#7196),
[#7559](#7559),
[#7421](#7421),
[#7510](#7510),
[#7295](#7295), and
[#7565](#7565) ->
`docs/changelog/2026-07-25.mdx`: Document gateway-scoped status,
lifecycle diagnostics, managed MCP recovery, delete-edge safeguards, and
fail-closed CLI prompt and command output.
- [#7591](#7591) ->
`docs/changelog/2026-07-25.mdx`: Document opt-in authenticated MCP
tool-name discovery, its bounded and names-only contract, probe
interaction, and rebuild requirement.
- [#7305](#7305),
[#7480](#7480),
[#7471](#7471),
[#7365](#7365), and
[#7541](#7541) ->
`docs/changelog/2026-07-25.mdx`: Document installer version checks,
version-tag reporting, license guidance, WSL Ollama selection, and DGX
Station vLLM detection.
- [#7482](#7482),
[#7466](#7466),
[#7208](#7208),
[#7434](#7434), and
[#7586](#7586) ->
`docs/changelog/2026-07-25.mdx`: Document Ollama resource details,
reasoning precedence, Hermes onboarding behavior, and preserved managed
Hermes BuildKit failures.

- [#6830](#6830),
[#7492](#7492),
[#7563](#7563), and
[#7582](#7582) ->
`docs/changelog/2026-07-25.mdx`: Document the authoritative OpenClaw
production lock, fixed managed-image dependencies, immutable Hermes base
adoption, and Hermes image-size reduction.
- [#7505](#7505),
[#7530](#7530),
[#7547](#7547),
[#7508](#7508),
[#7548](#7548),
[#7549](#7549),
[#7537](#7537),
[#7534](#7534),
[#7515](#7515),
[#7511](#7511),
[#7551](#7551),
[#7562](#7562),
[#7575](#7575),
[#7496](#7496),
[#7594](#7594),
[#7595](#7595), and
[#7599](#7599) ->
`docs/changelog/2026-07-25.mdx`: Summarize release validation, transient
and bounded dispatch reconciliation, exact pre-tag qualification,
identity revalidation, npm-audit retry, sharding, image reuse, timeout,
telemetry, and workflow-hardening changes.
- Reconciled without separate changelog prose:
- [#7539](#7539),
[#7526](#7526),
[#7507](#7507),
[#7506](#7506),
[#7519](#7519),
[#7516](#7516),
[#7396](#7396),
[#7254](#7254),
[#7583](#7583),
[#7596](#7596), and
[#7598](#7598): Test-harness or
fixture-only changes.
- [#7403](#7403),
[#7161](#7161),
[#6877](#6877),
[#7531](#7531),
[#7525](#7525),
[#7522](#7522),
[#7536](#7536),
[#7552](#7552),
[#7566](#7566),
[#7553](#7553),
[#7561](#7561),
[#7577](#7577),
[#7569](#7569),
[#7585](#7585),
[#7584](#7584),
[#7592](#7592),
[#7580](#7580),
[#7571](#7571),
[#7517](#7517),
[#7589](#7589),
[#7402](#7402),
[#7558](#7558),
[#7544](#7544), and
[#7601](#7601): Dependency,
internal recovery, validation, contributor-workflow, E2E optimization,
telemetry, or CI trust changes with no separate user-facing release
claim.
- [#7556](#7556),
[#7573](#7573),
[#7576](#7576), and
[#7578](#7578): Experimental
repository-maintainer conflict automation with no canonical user
documentation surface.

## Type of Change

- [ ] Code change (feature, bug fix, or refactor)
- [ ] Code change with doc updates
- [x] Doc only (prose changes, no code sample modifications)
- [ ] Doc only (includes code sample changes)

## Quality Gates

- [ ] Tests added or updated for changed behavior
- [x] Existing tests cover changed behavior β€” justification:
`test/changelog-docs.test.ts` validates dated changelog structure,
version headings, and published links.
- [ ] Tests not applicable β€” justification:
- [x] Docs updated for user-facing behavior changes
- [ ] Docs not applicable β€” justification:
- [ ] Sensitive paths changed (security, policy, credentials, preflight,
onboarding, inference, runner, sandbox, or messaging)
- [ ] Sensitive-path review completed or maintainer-approved waiver
recorded β€” reviewer/approval link/justification:
- [ ] Non-success, skipped, or missing CI check accepted by maintainer β€”
check name, approval link, and follow-up issue:

## Documentation Writer Review

- [x] Documentation writer subagent reviewed the completed changes
- Result: `docs-updated`
- Evidence: Reviewed `docs/changelog/2026-07-25.mdx` at exact head
`0f5dedb47` against 90 first-parent release commits and 92 merged PRs
labeled `v0.0.96`. Verified parser-safe MDX SPDX, the exact version
heading, literal CLI names, writing style, skip terms, all 20
root-absolute published links, and the accepted #7591 opt-in
authenticated discovery bounds. #7544, #7599, and #7601 remain internal
or CI-only release-ledger entries. Changelog tests passed 6/6, the docs
build passed with 0 errors and two pre-existing Fern warnings, and `npm
run check:diff` plus the final diff check passed.
- Agent: Codex Desktop documentation-writer subagent
<!-- docs-review-head-sha: 0f5dedb -->
<!-- docs-review-agents-blob-sha: be20a09 -->

## DGX Station Hardware Evidence

- [ ] Tested on DGX Station
- Tested commit:
- Station profile/scenario:
- Result:
- Supporting evidence:

## Verification

- [x] PR description includes a `Signed-off-by:` line and every commit
appears as `Verified` in GitHub
- [x] Normal `pre-commit`, `commit-msg`, and `pre-push` hooks passed, or
`npm run check:diff` passed when hooks were skipped or unavailable
- [x] Targeted behavior tests pass for the current change set, or tests
are marked not applicable above β€” `npx vitest run
test/changelog-docs.test.ts`: 6/6 passed.
- [ ] Applicable broad gate passed β€” `npm test` for broad
runtime/test-harness changes; `npm run check` for repo-wide
validation/coverage changes β€” command/result: Not applicable to this
prose-only changelog entry.
- [x] Quality Gates section completed with required justifications or
waivers
- [x] No secrets, API keys, or credentials committed
- [ ] `npm run docs` builds without warnings (doc changes only) β€” the
build passed with 0 errors and 2 existing Fern warnings; the
published-route check passed.
- [x] Doc pages follow the [style
guide](https://github.com/NVIDIA/NemoClaw/blob/main/docs/CONTRIBUTING.md)
(doc changes only)
- [ ] New doc pages include SPDX header and frontmatter (new pages only)
β€” native changelog files use the required parser-safe MDX SPDX comment
and no frontmatter.

---
Signed-off-by: Carlos Villela <cvillela@nvidia.com>


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **New Features**
* Persistent network policy exclusions with consistent restore/exclusion
reporting across rebuilds/snapshots.
* Opt-in MCP tool discovery via `mcp status --tools` with bounded,
redacted authenticated traffic.
* Improved HTTPS inference switching for custom endpoints and refreshed
onboarding/model menu details.
* Refined OpenShell gateway defaults for port `8080`, including more
reliable readiness checks.
* **Bug Fixes**
* Prevent incorrect provider/model restoration after compatible-provider
update failures.
* Preserve managed MCP state after exec loss and tighten gateway/doctor
status scoping.
* **Tests**
* Stronger, fail-closed release validation with hardened
evidence/artifact handoff and bounded timeouts/retries.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com>
Co-authored-by: Prekshi Vyas <prekshiv@nvidia.com>
@wscurran wscurran added area: inference Inference routing, serving, model selection, or outputs area: providers Inference provider integrations and provider behavior area: routing Request routing, policy routing, model selection, or fallback logic bug-fix PR fixes a bug or regression labels Jul 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: inference Inference routing, serving, model selection, or outputs area: providers Inference provider integrations and provider behavior area: routing Request routing, policy routing, model selection, or fallback logic bug-fix PR fixes a bug or regression

Projects

None yet

4 participants