Compare frameworks

DeepEval vs CrewAI vs Mastra

Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
DeepEval vs CrewAI vs Mastra, compared across 20 tracked fields. Each value shows the source that reported it and when.
FieldDeepEvalCrewAIMastra
Stars
19,359Synced from sourceCurrent3h ago
60,624 (highest of the compared values)Synced from sourceCurrent3h ago
29,400Synced from sourceCurrent3h ago
downloads——
3,150,478Synced from sourceCurrent3h ago
Last commit
2026-11-07Synced from sourceCurrent3h ago
2026-11-08Synced from sourceCurrent3h ago
2026-11-08Synced from sourceCurrent3h ago
Language
pythonSeeded, unreviewedwritten 2mo ago
pythonSeeded, unreviewedwritten 2mo ago
typescriptSeeded, unreviewedwritten 2mo ago
Licence
Apache-2.0Synced from sourceCurrent3h ago
MITSynced from sourceCurrent3h ago
—
Archived
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
Category
evaluationSeeded, unreviewedwritten 2mo ago
multi-agentSeeded, unreviewedwritten 2mo ago
orchestrationSeeded, unreviewedwritten 2mo ago
Contributors
348Synced from sourceCurrent3h ago
367Synced from sourceCurrent3h ago
701Synced from sourceCurrent3h ago
Forks
2177Synced from sourceCurrent3h ago
9090Synced from sourceCurrent3h ago
3085Synced from sourceCurrent3h ago
Maintainer
Confident AISeeded, unreviewedwritten 2mo ago
CrewAISeeded, unreviewedwritten 2mo ago
MastraSeeded, unreviewedwritten 2mo ago
npm downloads, monthly——
10391822Synced from sourceCurrent3h ago
npm downloads, weekly——
3150478Synced from sourceCurrent3h ago
npm package——
@mastra/coreSynced from sourceCurrent3h ago
npm window ends——
2026-11-06Synced from sourceCurrent3h ago
Open issues
814Synced from sourceCurrent3h ago
1196Synced from sourceCurrent3h ago
820Synced from sourceCurrent3h ago
PyPI package
deepevalSynced from sourceCurrent3h ago
crewaiSynced from sourceCurrent3h ago
—
PyPI released
2026-11-04T11:29:23.499144ZSynced from sourceCurrent3h ago
2026-11-07T02:18:43.372746ZSynced from sourceCurrent3h ago
—
Requires Python
<4.0,>=3.9Synced from sourceCurrent3h ago
<3.14,>=3.10Synced from sourceCurrent3h ago
—
PyPI version
4.3.3Synced from sourceCurrent3h ago
1.15.37Synced from sourceCurrent3h ago
—
Repository
https://github.com/confident-ai/deepevalSynced from sourceCurrent3h ago
https://github.com/crewAIInc/crewAISynced from sourceCurrent3h ago
https://github.com/mastra-ai/mastraSynced from sourceCurrent3h ago

Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 3h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.

Change the comparison

Remove one, or open the directory to pick a different set. Up to 3 at a time.


Every figure on this site resolves to the source that reported it, the moment it was observed, and how it was measured. A value that fails validation is withheld rather than shown — withheld means we refused to publish it, not that it is zero.