Compare frameworks
DeepEval vs LlamaIndex vs Mastra
Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
| Field | DeepEval | LlamaIndex | Mastra |
|---|---|---|---|
| Stars | 18,419Synced from sourceCurrent4h ago | 52,306 (highest of the compared values)Synced from sourceCurrent4h ago | 28,295Synced from sourceCurrent4h ago |
| downloads | — | 83,631Synced from sourceCurrent4h ago | 1,161,907 (highest of the compared values)Synced from sourceCurrent4h ago |
| Last commit | 2026-09-23Synced from sourceCurrent4h ago | 2026-09-24Synced from sourceCurrent4h ago | 2026-09-24Synced from sourceCurrent4h ago |
| Language | pythonSeeded, unreviewedwritten 1mo ago | pythonSeeded, unreviewedwritten 1mo ago | typescriptSeeded, unreviewedwritten 1mo ago |
| Licence | Apache-2.0Synced from sourceCurrent4h ago | MITSynced from sourceCurrent4h ago | — |
| Archived | noSynced from sourceCurrent4h ago | noSynced from sourceCurrent4h ago | noSynced from sourceCurrent4h ago |
| Category | evaluationSeeded, unreviewedwritten 1mo ago | ragSeeded, unreviewedwritten 1mo ago | orchestrationSeeded, unreviewedwritten 1mo ago |
| Contributors | 337Synced from sourceCurrent4h ago | 1999Synced from sourceCurrent4h ago | 678Synced from sourceCurrent4h ago |
| Forks | 1973Synced from sourceCurrent4h ago | 8203Synced from sourceCurrent4h ago | 2845Synced from sourceCurrent4h ago |
| Maintainer | Confident AISeeded, unreviewedwritten 1mo ago | LlamaIndexSeeded, unreviewedwritten 1mo ago | MastraSeeded, unreviewedwritten 1mo ago |
| npm downloads, monthly | — | 429018Synced from sourceCurrent4h ago | 5528725Synced from sourceCurrent4h ago |
| npm downloads, weekly | — | 83631Synced from sourceCurrent4h ago | 1161907Synced from sourceCurrent4h ago |
| npm package | — | llamaindexSynced from sourceCurrent4h ago | @mastra/coreSynced from sourceCurrent4h ago |
| npm window ends | — | 2026-09-21Synced from sourceCurrent4h ago | 2026-09-21Synced from sourceCurrent4h ago |
| Open issues | 654Synced from sourceCurrent4h ago | 849Synced from sourceCurrent4h ago | 447Synced from sourceCurrent4h ago |
| PyPI package | deepevalSynced from sourceCurrent4h ago | llama-indexSynced from sourceCurrent4h ago | — |
| PyPI released | 2026-09-22T19:26:34.903554ZSynced from sourceCurrent4h ago | 2026-09-21T16:22:20.056831ZSynced from sourceCurrent4h ago | — |
| Requires Python | <4.0,>=3.9Synced from sourceCurrent4h ago | <4.0,>=3.10Synced from sourceCurrent4h ago | — |
| PyPI version | 4.2.5Synced from sourceCurrent4h ago | 0.14.25Synced from sourceCurrent4h ago | — |
| Repository | https://github.com/confident-ai/deepevalSynced from sourceCurrent4h ago | https://github.com/run-llama/llama_indexSynced from sourceCurrent4h ago | https://github.com/mastra-ai/mastraSynced from sourceCurrent4h ago |
Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 4h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.
Change the comparison
Remove one, or open the directory to pick a different set. Up to 3 at a time.