-
Notifications
You must be signed in to change notification settings - Fork 59
Improve scenario prompt error messages HUD-522 #249
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💡 Codex Review
Here are some automated review suggestions for this pull request.
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
0d41a10 to
3d3733c
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💡 Codex Review
Here are some automated review suggestions for this pull request.
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
- Add context-aware errors in MCPAgent when ctx.prompt is not set - Show available scenarios when requested scenario is not found - Handle malformed and empty scenario responses with clear messages
3d3733c to
013eeae
Compare
Note
Enhances scenario prompt error handling/validation, clarifies agent errors for missing prompts, and adds robust cleanup on eval context setup failure.
hud/environment/scenarios.py):get_promptresponses: raise on empty messages, malformed content, or non-string content.hud/agents/base.py):ctx.promptis missing, with targeted error messages.hud/eval/context.py):__aenter__with cleanup on failure, resetting context vars and disconnecting the environment before re-raising.Written by Cursor Bugbot for commit 013eeae. This will update automatically on new commits. Configure here.