Issues

• v2 prompt and data: program-specific disability facts, integer inputs, and the take-up boundary

  PolicyEngine/policybench#165 · Filter by author MaxGhenis opened on Sep 5, 2026
  1

• Explanation contract is unenforced — set the v2 scoring policy

  PolicyEngine/policybench#145 · Filter by author MaxGhenis opened on Aug 10, 2026
  1

• Record Anthropic thinking tokens from the raw response (litellm reports 0)

  PolicyEngine/policybench#140 · Filter by author MaxGhenis opened on Aug 8, 2026

• v2 board condition: move every model to tool_choice auto

  PolicyEngine/policybench#139 · Filter by author MaxGhenis opened on Aug 8, 2026
  2

• Supervisor budget meter ignores PRICE_OVERRIDES_PER_1M

  PolicyEngine/policybench#129 · Filter by author MaxGhenis opened on Jul 22, 2026

• Restore public cost reporting with cumulative, comparable accounting

  PolicyEngine/policybench#118 · Filter by author MaxGhenis opened on Jul 9, 2026

• Scenario refresh: state SSA disability status and dependent relationships explicitly

  PolicyEngine/policybench#111 · Filter by author MaxGhenis opened on Jul 7, 2026

• Batch rerun on a completed run dir replays early rounds and regresses the CSV

  PolicyEngine/policybench#102 · Filter by author MaxGhenis opened on Jul 5, 2026

• scenario_121 encodes disability in inputs PE does not map to USDA disability, zeroing SNAP

  PolicyEngine/policybench#92 · Filter by author MaxGhenis opened on Jul 2, 2026

• Triage 16 reference-suspect cases from the Claude 5 failure audit

  PolicyEngine/policybench#91 · Filter by author MaxGhenis opened on Jul 2, 2026
  2

• Make Claude runs parallel-safe by moving the hard timeout to the chunk subprocess

  PolicyEngine/policybench#84 · Filter by author MaxGhenis opened on Jul 2, 2026

• Child slot labels should be youngest-first, not oldest-first

  PolicyEngine/policybench#50 · Filter by author MaxGhenis opened on May 19, 2026

• Align benchmark prompts with PolicyEngine target-year input values

  PolicyEngine/policybench#19 · Filter by author MaxGhenis opened on May 14, 2026
  3

• Determinism and reproducibility hardening

  PolicyEngine/policybench#6 · Filter by author MaxGhenis opened on May 2, 2026

• Keep DeepSeek out of public leaderboard until benchmark requests complete reliably

  PolicyEngine/policybench#4 · Filter by author MaxGhenis opened on May 1, 2026