Skip to content

fix(docs-agent): close citation footer validation bypass - #895

Draft
langsmith-engine[bot] wants to merge 1 commit into
vishnu/mda-github-deploymentfrom
issues-agent/28065b2a-d837-4c27-a9c5-3d4b051a20ca
Draft

langsmith-engine[bot] wants to merge 1 commit into
vishnu/mda-github-deploymentfrom
issues-agent/28065b2a-d837-4c27-a9c5-3d4b051a20ca

Conversation

@langsmith-engine

Copy link
Copy Markdown

The citation guard returned retry responses without rechecking their Relevant docs footer, allowing retries to introduce fabricated or dead URLs. It now performs bounded retries, revalidates each response, fails closed by removing the footer, treats fragments as grounded only when their slugs appear in retrieved page content, honors Invalid links reports, and resolves offloaded documentation evidence through the filesystem backend.\n\nFocused middleware tests cover fabricated fragments, invalid check_links results, retry-introduced citations, unresolved offloaded evidence, and the bounded fail-closed retry path. The separate docs research guard remains unchanged.


Opened from a LangSmith Engine issue, which has the diagnosis and the traces that surfaced it.

The citation guard returned retry responses without rechecking their Relevant docs footer, allowing retries to introduce fabricated or dead URLs. It now performs bounded retries, revalidates each response, fails closed by removing the footer, treats fragments as grounded only when their slugs appear in retrieved page content, honors Invalid links reports, and resolves offloaded documentation evidence through the filesystem backend.\n\nFocused middleware tests cover fabricated fragments, invalid check_links results, retry-introduced citations, unresolved offloaded evidence, and the bounded fail-closed retry path. The separate docs research guard remains unchanged.
@vercel

vercel Bot commented Sep 14, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
chat-langchain Ready Ready Preview Sep 14, 2026 10:01pm UTC
chat-langchain-on-mda Ready Ready Preview Sep 14, 2026 10:01pm UTC

Request Review

@hosted-langserve

hosted-langserve Bot commented Sep 14, 2026

Copy link
Copy Markdown

LangSmith preview deployment is ready.

This preview is ready for the current PR commit.

@hosted-langserve-dev

hosted-langserve-dev Bot commented Sep 14, 2026

Copy link
Copy Markdown

LangSmith preview deployment failed.

@hosted-langserve

hosted-langserve Bot commented Sep 14, 2026

Copy link
Copy Markdown

LangSmith preview deployment was torn down.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants