Skip to content

evalset_result is serialized string #3869

@marapper

Description

@marapper

Describe the bug
While files as some_agent_evalset_correctness_1765207385.9918857.evalset_result.json are technically JSON, in fact, it is saved as a string with serialised json.

"{\"eval_set_result_id\":\"dossier_manager_agent_evalset_correctness_1765207385.9918857\",\"eval_set_result_name\":\"dossier_manager_agent_evalset_correctness_1765207385.9918857\",\

Expected behavior

It could be correct JSON to parse it in more convenient way.

{
  "eval_set_result_id": "dossier_manager_agent_evalset_correctness_1765207385.9918857",
  "eval_set_result_name": "dossier_manager_agent_evalset_correctness_1765207385.9918857",
  "eval_set_id": "evalset_correctness",
  "eval_case_results": [
    {

Desktop (please complete the following information):

  • OS: macOS
  • Python version(python -V): 3.11.5
  • ADK version(pip show google-adk): 1.20

Model Information:

  • Are you using LiteLLM: No
  • Which model is being used: gemini-2.5-flash-lite

Additional context
None.

Metadata

Metadata

Assignees

Labels

answered[Status] This issue has been answered by the maintainereval[Component] This issue is related to evaluation

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions