-
Notifications
You must be signed in to change notification settings - Fork 2
Reduce test runtime by using 32 epochs and TESTING env var #254
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
- Added TESTING environment variable check in create_datasets.py - When TESTING=1, use 32 epochs instead of 512 for calibration - Updated both push.yaml and pull_request.yaml workflows to set TESTING=1 - This reduces test runtime from ~40 minutes to a much more manageable duration 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine needs a changelog entry |
|
✅ Added changelog entry for version 1.29.3 documenting the test runtime reduction. The entry has been committed and pushed to the PR branch. |
Added entry for version 1.29.3 documenting the reduction in test runtime when using the TESTING environment variable. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine nope, you messed up here. when I refer to a changelog entry, i'm talking about changelog_entry.yaml which must be on all PRs. revert your change and do that |
|
Fixed! I reverted the incorrect CHANGELOG.md changes and created the proper - bump: patch
changes:
changed:
- Reduced test runtime by using 32 epochs instead of 512 when TESTING environment variable is setThe changes have been committed and pushed to the PR branch. |
This reverts commit 80fb411.
Added proper changelog entry documenting the test runtime reduction when using the TESTING environment variable. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine relax the failing test conditions |
|
✅ Relaxed the failing test conditions:
These adjustments account for expected variance when running with reduced epochs (32 instead of 512) in test mode. Changes committed and pushed. |
- Increase VAT reform tolerance from 3.0 to 5.0 billion - Increase vehicle ownership tolerance from 10% to 15% These adjustments account for expected variance when running with reduced epochs in test mode. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Summary
Reduces CI test runtime from ~40 minutes to a much more manageable duration by using 32 epochs instead of 512 when running in test mode.
Changes
TESTINGenvironment variable check increate_datasets.pyTESTING=1, use 32 epochs instead of 512 for calibration (both constituency and local authority)push.yamlandpull_request.yamlworkflows to setTESTING=1Impact
TESTINGisn't set) still use full 512 epochs for maximum accuracyRelated
🤖 Generated with Claude Code