Compare frameworks

DeepEval vs Agno vs Mastra

Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
DeepEval vs Agno vs Mastra, compared across 22 tracked fields. Each value shows the source that reported it and when.
FieldDeepEvalAgnoMastra
Stars
18,419Synced from sourceCurrent3h ago
42,325 (highest of the compared values)Synced from sourceCurrent3h ago
28,295Synced from sourceCurrent3h ago
downloads
520,626Synced from sourceStale1mo ago· past SLA
1,161,907 (highest of the compared values)Synced from sourceCurrent3h ago
Last commit
2026-09-23Synced from sourceCurrent3h ago
2026-09-23Synced from sourceCurrent3h ago
2026-09-24Synced from sourceCurrent3h ago
Language
pythonSeeded, unreviewedwritten 1mo ago
pythonSeeded, unreviewedwritten 1mo ago
typescriptSeeded, unreviewedwritten 1mo ago
Licence
Apache-2.0Synced from sourceCurrent3h ago
Apache-2.0Synced from sourceCurrent3h ago
Archived
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
Category
evaluationSeeded, unreviewedwritten 1mo ago
orchestrationSeeded, unreviewedwritten 1mo ago
orchestrationSeeded, unreviewedwritten 1mo ago
Contributors
337Synced from sourceCurrent3h ago
581Synced from sourceCurrent3h ago
678Synced from sourceCurrent3h ago
Forks
1973Synced from sourceCurrent3h ago
5999Synced from sourceCurrent3h ago
2845Synced from sourceCurrent3h ago
Maintainer
Confident AISeeded, unreviewedwritten 1mo ago
AgnoSeeded, unreviewedwritten 1mo ago
MastraSeeded, unreviewedwritten 1mo ago
npm downloads, monthly
5528725Synced from sourceCurrent3h ago
npm downloads, weekly
1161907Synced from sourceCurrent3h ago
npm package
@mastra/coreSynced from sourceCurrent3h ago
npm window ends
2026-09-21Synced from sourceCurrent3h ago
Open issues
654Synced from sourceCurrent3h ago
1611Synced from sourceCurrent3h ago
447Synced from sourceCurrent3h ago
PyPI downloads, monthly
2183543Synced from sourceStale1mo ago· past SLA
PyPI downloads, weekly
520626Synced from sourceStale1mo ago· past SLA
PyPI package
deepevalSynced from sourceCurrent3h ago
agnoSynced from sourceCurrent3h ago
PyPI released
2026-09-22T19:26:34.903554ZSynced from sourceCurrent3h ago
2026-09-23T13:15:37.685447ZSynced from sourceCurrent3h ago
Requires Python
<4.0,>=3.9Synced from sourceCurrent3h ago
<4,>=3.9Synced from sourceCurrent3h ago
PyPI version
4.2.5Synced from sourceCurrent3h ago
3.0.11Synced from sourceCurrent3h ago
Repository
https://github.com/confident-ai/deepevalSynced from sourceCurrent3h ago
https://github.com/agno-agi/agnoSynced from sourceCurrent3h ago
https://github.com/mastra-ai/mastraSynced from sourceCurrent3h ago

Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 3h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.

Change the comparison

Remove one, or open the directory to pick a different set. Up to 3 at a time.


Every figure on this site resolves to the source that reported it, the moment it was observed, and how it was measured. A value that fails validation is withheld rather than shown — withheld means we refused to publish it, not that it is zero.