Compare frameworks
DeepEval vs smolagents vs Mastra
Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
| Field | DeepEval | smolagents | Mastra |
|---|---|---|---|
| Stars | 18,419Synced from sourceCurrent3h ago | 29,463 (highest of the compared values)Synced from sourceCurrent3h ago | 28,295Synced from sourceCurrent3h ago |
| downloads | — | 132,630Synced from sourceStale1mo ago· past SLA | 1,161,907 (highest of the compared values)Synced from sourceCurrent3h ago |
| Last commit | 2026-09-23Synced from sourceCurrent3h ago | 2026-09-23Synced from sourceCurrent3h ago | 2026-09-24Synced from sourceCurrent3h ago |
| Language | pythonSeeded, unreviewedwritten 1mo ago | pythonSeeded, unreviewedwritten 1mo ago | typescriptSeeded, unreviewedwritten 1mo ago |
| Licence | Apache-2.0Synced from sourceCurrent3h ago | Apache-2.0Synced from sourceCurrent3h ago | — |
| Archived | noSynced from sourceCurrent3h ago | noSynced from sourceCurrent3h ago | noSynced from sourceCurrent3h ago |
| Category | evaluationSeeded, unreviewedwritten 1mo ago | multi-agentSeeded, unreviewedwritten 1mo ago | orchestrationSeeded, unreviewedwritten 1mo ago |
| Contributors | 337Synced from sourceCurrent3h ago | 208Synced from sourceCurrent3h ago | 678Synced from sourceCurrent3h ago |
| Forks | 1973Synced from sourceCurrent3h ago | 2991Synced from sourceCurrent3h ago | 2845Synced from sourceCurrent3h ago |
| Maintainer | Confident AISeeded, unreviewedwritten 1mo ago | Hugging FaceSeeded, unreviewedwritten 1mo ago | MastraSeeded, unreviewedwritten 1mo ago |
| npm downloads, monthly | — | — | 5528725Synced from sourceCurrent3h ago |
| npm downloads, weekly | — | — | 1161907Synced from sourceCurrent3h ago |
| npm package | — | — | @mastra/coreSynced from sourceCurrent3h ago |
| npm window ends | — | — | 2026-09-21Synced from sourceCurrent3h ago |
| Open issues | 654Synced from sourceCurrent3h ago | 827Synced from sourceCurrent3h ago | 447Synced from sourceCurrent3h ago |
| PyPI downloads, monthly | — | 614573Synced from sourceStale1mo ago· past SLA | — |
| PyPI downloads, weekly | — | 132630Synced from sourceStale1mo ago· past SLA | — |
| PyPI package | deepevalSynced from sourceCurrent3h ago | smolagentsSynced from sourceCurrent3h ago | — |
| PyPI released | 2026-09-22T19:26:34.903554ZSynced from sourceCurrent3h ago | 2026-05-29T05:08:43.280962ZSynced from sourceCurrent3h ago | — |
| Requires Python | <4.0,>=3.9Synced from sourceCurrent3h ago | >=3.10Synced from sourceCurrent3h ago | — |
| PyPI version | 4.2.5Synced from sourceCurrent3h ago | 1.26.0Synced from sourceCurrent3h ago | — |
| Repository | https://github.com/confident-ai/deepevalSynced from sourceCurrent3h ago | https://github.com/huggingface/smolagentsSynced from sourceCurrent3h ago | https://github.com/mastra-ai/mastraSynced from sourceCurrent3h ago |
Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 3h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.
Change the comparison
Remove one, or open the directory to pick a different set. Up to 3 at a time.