-
Notifications
You must be signed in to change notification settings - Fork 2.7k
Open
Labels
answered[Status] This issue has been answered by the maintainer[Status] This issue has been answered by the maintainereval[Component] This issue is related to evaluation[Component] This issue is related to evaluation
Description
Describe the bug
While files as some_agent_evalset_correctness_1765207385.9918857.evalset_result.json are technically JSON, in fact, it is saved as a string with serialised json.
"{\"eval_set_result_id\":\"dossier_manager_agent_evalset_correctness_1765207385.9918857\",\"eval_set_result_name\":\"dossier_manager_agent_evalset_correctness_1765207385.9918857\",\
Expected behavior
It could be correct JSON to parse it in more convenient way.
{
"eval_set_result_id": "dossier_manager_agent_evalset_correctness_1765207385.9918857",
"eval_set_result_name": "dossier_manager_agent_evalset_correctness_1765207385.9918857",
"eval_set_id": "evalset_correctness",
"eval_case_results": [
{
Desktop (please complete the following information):
- OS: macOS
- Python version(python -V): 3.11.5
- ADK version(pip show google-adk): 1.20
Model Information:
- Are you using LiteLLM: No
- Which model is being used: gemini-2.5-flash-lite
Additional context
None.
Metadata
Metadata
Assignees
Labels
answered[Status] This issue has been answered by the maintainer[Status] This issue has been answered by the maintainereval[Component] This issue is related to evaluation[Component] This issue is related to evaluation