|
||
---|---|---|
docs | ||
examples | ||
src/smolagents | ||
tests | ||
.gitignore | ||
Dockerfile | ||
LICENSE | ||
Makefile | ||
README.md | ||
e2b.Dockerfile | ||
e2b.toml | ||
pyproject.toml | ||
requirements.in | ||
server.py |
README.md
🤗 smolagents - a smol library to build great agents!
smolagents
is a library that enables you to run powerful agents in a few lines of code. It offers:
✨ Simplicity: the logic for agents fits in ~thousand lines of code. We kept abstractions to their minimal shape above raw code!
🌐 Support for any LLM: it supports models hosted on the Hub loaded in their transformers
version or through our inference API, but also models from OpenAI, Anthropic, and many more through our LiteLLM integration.
🧑💻 First-class support for Code Agents, i.e. agents that write their actions in code (as opposed to "agents being used to write code"), read more here.
🤗 Hub integrations: you can share and load tools to/from the Hub, and more is to come!
Quick demo
First install the package.
pip install smolagents
Then define your agent, give it the tools it needs and run it!
from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel
agent = CodeAgent(tools=[DuckDuckGoSearchTool()], model=HfApiModel())
agent.run("What time would it take for a leopard at full speed to run through Pont des Arts?")
https://github.com/user-attachments/assets/cd0226e2-7479-4102-aea0-57c22ca47884
Code agents?
In our CodeAgent
, the LLM engine writes its actions in code. This approach is demonstrated to work better than the current industry practice of letting the LLM output a dictionary of the tools it wants to calls: uses 30% fewer steps (thus 30% fewer LLM calls)
and reaches higher performance on difficult benchmarks. Head to our high-level intro to agents to learn more on that.
Especially, since code execution can be a security concern (arbitrary code execution!), we provide options at runtime:
- a secure python interpreter to run code more safely in your environment
- a sandboxed environment using E2B.
How lightweight is it?
We strived to keep abstractions to a strict minimum: the main code in agents.py
is only ~1,000 lines of code.
Still, we implement several types of agents: CodeAgent
writing its actions in code snippets, and the more classic ToolCallingAgent
that leverage built-in tool calling methods.
Many people ask: why use a framework at all? Well, because a big part of this stuff is non-trivial. For instance, the code agent has to keep a consistent format for code throughout its system prompt, its parser, the execution. So our framework handles this complexity for you. But of course we still encourage you to hack into the source code and use only the bits that you need, to the exclusion of everything else!
Citing smolagents
If you use smolagents
in your publication, please cite it by using the following BibTeX entry.
@Misc{accelerate,
title = {`smolagents`: The easiest way to build efficient agentic systems.},
author = {Aymeric Roucher and Thomas Wolf and Leandro von Werra and Erik Kaunismäki},
howpublished = {\url{https://github.com/huggingface/smolagents}},
year = {2025}
}