Repository navigation
bench: add 100-page and 500-page corpora - #264
Merged
Merged
Conversation
Extends the original ten-page urls.txt with two larger, more varied sets built from each site's own sitemap and checked for a live HTTP 200 at collection time: urls-100.txt (100 pages, roughly two dozen hosts) and urls-500.txt (500 pages across 268 distinct sites, at most four per site). Run with: go run ./cmd/compare -urls urls-100.txt -report REPORT-100.md -json results-100.json -out out-100 (and the -500 equivalents), keeping the canonical ten-page REPORT.md/results.json untouched. No measured numbers are committed yet; a run against urls-500.txt found and was blocked by a real renderer crash (fixed separately, engine#263). Full results follow once a clean run completes. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Extends the original ten-page
urls.txtwith two larger, more varied sets, each built from its sites' own sitemaps and checked for a live HTTP 200 at collection time:urls-100.txt: 100 pages.urls-500.txt: 500 pages across 268 distinct sites, at most four per site.Each runs against its own output files (
-report/-json/-out), so the canonical ten-pageREPORT.md/results.jsonstay untouched. No measured numbers are committed yet — a first run againsturls-500.txtfound and was blocked by a real renderer crash, fixed separately in #263. Full results follow once a clean run completes.🤖 Generated with Claude Code