KeyArgo
/
smolagents
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Fix vanilla model answer in example benchmark (#219)

This commit is contained in:
Albert Villanova del Moral 2025-01-16 12:04:41 +01:00 committed by GitHub
parent 72b01a9909
commit 2a69f1574e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/benchmark.ipynb
View File

@ -253,7 +253,7 @@
"\n", "\n",
" if is_vanilla_llm:\n", " if is_vanilla_llm:\n",
" llm = agent\n", " llm = agent\n",
" answer = str(llm([{\"role\": \"user\", \"content\": question}]))\n", " answer = str(llm([{\"role\": \"user\", \"content\": question}]).content)\n",
" token_count = {\"input\": llm.last_input_token_count, \"output\": llm.last_output_token_count}\n", " token_count = {\"input\": llm.last_input_token_count, \"output\": llm.last_output_token_count}\n",
" intermediate_steps = str([])\n", " intermediate_steps = str([])\n",
" else:\n", " else:\n",