Repository navigation
docs: document malformed isAuthorized results (base-std@3820cf0) - #2069
Closed
github-actions[bot] wants to merge 0 commit into
Closed
github-actions[bot] wants to merge 0 commit into
github-actions[bot] wants to merge 0 commit into
Conversation
Collaborator
🟡 Heimdall Review Status
|
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Automations to automatically generate PRs for you. |
soheimam
added a commit
that referenced
this pull request
Oct 5, 2026
Each page call returns the full regenerated page. Under Sonnet 5.5 the 4096-token cap truncated seize-and-cancel-units.mdx (8,955 chars), so the page was rejected and dropped from the sync PR (#2069 vs #2054). - DEFAULT_MAX_TOKENS: 4096 -> 16384 (CLAUDE_MAX_TOKENS still overrides) - MAX_REGENERABLE_CHARS: 10000 -> 32000 to match the new budget (~2.2 chars/token measured on Sonnet 5.5) Co-authored-by: Toshi <toshi-noreply@coinbase.com>
github-actions
Bot
force-pushed
the
docs/sync-code-change-3820cf0
branch
from
October 5, 2026 15:51
f4102c9 to
5ceae24
Compare
soheimam
added a commit
that referenced
this pull request
Oct 6, 2026
* test(docs-sync): add eval harness and the base-std@3820cf0 case run-eval.mjs runs the working-tree (or --code-ref) sync code against a pinned docs commit in a throwaway worktree and scores the result against the case's expectations: pages that must, may, and must not change, edit budgets for secondary pages, and restatement of full rules outside their owner pages. The first case is base-std#234 (3820cf0), a NatSpec-only clarification of isAuthorized that the sync spread across ~10 pages (#2054, #2069, #2072). Co-authored-by: Toshi <toshi-noreply@coinbase.com> * fix(docs-sync): stop guide pages being edited for passing mentions - Rule 5: guides and concept pages change only when the source change makes a step, outcome, revert, or recommended setting on the page wrong; otherwise they are returned unchanged. Add 'one owner per fact': full behavior lives on the owning reference page; other pages link to it. - Rule 6: inventory documented surfaces, not mentions. A manifest entry that matches only a mention is not an intersection. Comment-only diffs clarify behavior; edit only statements they show to be wrong. - Step 4: polish only edited paragraphs; callouts only for real behavior changes, never for clarifications. - The anti-noop rule now applies to reference and changelog-entry pages that document the changed symbol, not to pages that only mention it. Co-authored-by: Toshi <toshi-noreply@coinbase.com> * fix(docs-sync): route comment-only changes to reference pages; skip historical pages - isCommentOnlyChange: a dispatch whose source diff only edits Solidity comments is a clarification. Symbol-mention routing then reaches only function-reference and interface-index pages, and the prompt is told the change type. - symbolRouteGate: pages found only by symbol mention are not routed when they are changelog entries for an earlier hardfork or upgrades/<fork>/ pages for a fork other than the newest. Path-routed pages are unaffected. Co-authored-by: Toshi <toshi-noreply@coinbase.com> * test(docs-sync): add base-std@1505323 recall case; must_mention and warn 1505323-token-self-recipient replays base-std#232, a real behavior change (transfers, mints, and seizes to the token's own address now revert) that reaches src/ only as NatSpec. It guards the other direction from the 3820cf0 case: the five function references that list InvalidReceiver must change, and their added lines must state the new condition. - must_mention: a regex the added lines of a page must match, so a cosmetic edit to a required page does not count. - unlisted_pages: "warn" reports pages outside the lists without failing. - README: how to run the evals and what each case guards. Co-authored-by: Toshi <toshi-noreply@coinbase.com> * fix(docs-sync): find NatSpec-documented members; guard code samples and retry streams From the base-std@1505323 eval (0/2 before, 6/6 after across both cases): - natspecDocumentedSymbols: a NatSpec hunk usually stops above the declaration it documents, so mint.mdx was skipped whenever the model's manifest happened not to name mint. Walk the post-change source (already fetched for changelog entries) from each changed comment line to the next declaration; function-reference pages for those members are always called. - isCommentOnlyChange: reference mocks (test/lib/mocks/) count as code. Base Std is interface-only, so NatSpec plus a mock change is a behavior change, not a clarification. The prompt no longer lets the model infer "clarification" from a comment-only diff slice; only the flag decides. - restoreCodeSamples: on guide pages, when no signature changed upstream, restore fenced code blocks (not mermaid) the model altered. A run had rewritten send-a-payout's functionName to "simulateContract". - normalizeForNoop: table re-padding alone is a noop. - llm/client: retry mid-stream overloaded/api errors twice with backoff; the SDK's maxRetries only covers the initial response, and one such error failed a whole sync in the eval. Co-authored-by: Toshi <toshi-noreply@coinbase.com> * docs(docs-sync): shrink the evals README section to a pointer Usage lives in the run-eval.mjs header and each case documents itself; the README only needs to say when to run it. Co-authored-by: Toshi <toshi-noreply@coinbase.com> --------- Co-authored-by: Toshi <toshi-noreply@coinbase.com>
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Auto-generated from the source PR above.
Reviewer checklist
Before merging, confirm each item below. The validator catches structural problems (raw HTML, dangerous URLs, secrets); these items need a human eye.
click here, no link text that contradicts its target host.title/descriptionstill match the page's role (reference vs. overview vs. conceptual).<Warning>added describes a real breaking change in the source PR, not a paraphrase the model invented.Newly introduced external URLs
No new external URLs in this sync.
Files touched
docs/base-chain/specs/reference/b20/changelog/03-denim-policyregistry-not-policy.mdxdocs/build-on-base/issue-rwa/restrict-transfer-initiators.mdxdocs/build-on-base/issue-stablecoins/block-an-account.mdxdocs/build-on-base/issue-stablecoins/restrict-who-can-hold.mdxdocs/specifications/b20/introduction.mdxdocs/specifications/b20/reference/constants.mdxdocs/specifications/b20/reference/interfaces/i-policy-registry/index.mdxdocs/specifications/b20/reference/interfaces/i-policy-registry/is-authorized.mdxSource provenance
Each row shows which file(s) in
base/base-std@3820cf0drove an edit to a docs page. Click into a source file to verify the claim before merging.docs/base-chain/specs/reference/b20/changelog/03-denim-policyregistry-not-policy.mdxsrc/interfaces/IPolicyRegistry.soldocs/build-on-base/issue-rwa/restrict-transfer-initiators.mdxsrc/interfaces/IPolicyRegistry.soldocs/build-on-base/issue-stablecoins/block-an-account.mdxsrc/interfaces/IPolicyRegistry.soldocs/build-on-base/issue-stablecoins/restrict-who-can-hold.mdxsrc/interfaces/IPolicyRegistry.soldocs/specifications/b20/introduction.mdxsrc/interfaces/IPolicyRegistry.soldocs/specifications/b20/reference/constants.mdxsrc/interfaces/IPolicyRegistry.soldocs/specifications/b20/reference/interfaces/i-policy-registry/index.mdxsrc/interfaces/IPolicyRegistry.soldocs/specifications/b20/reference/interfaces/i-policy-registry/is-authorized.mdxsrc/interfaces/IPolicyRegistry.solOpened by
Apply Base Std Updateworkflow.