Compare frameworks

Instructor vs DeepEval vs Pydantic AI

Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
Instructor vs DeepEval vs Pydantic AI, compared across 18 tracked fields. Each value shows the source that reported it and when.
FieldInstructorDeepEvalPydantic AI
Stars
14,101Synced from sourceCurrent3h ago
19,359Synced from sourceCurrent3h ago
21,085 (highest of the compared values)Synced from sourceCurrent3h ago
downloads
13,080,962 (highest of the compared values)Synced from sourceStale2mo ago· past SLA
—
3,076,771Synced from sourceStale2mo ago· past SLA
Last commit
2026-11-06Synced from sourceCurrent3h ago
2026-11-07Synced from sourceCurrent3h ago
2026-11-08Synced from sourceCurrent3h ago
Language
pythonSeeded, unreviewedwritten 2mo ago
pythonSeeded, unreviewedwritten 2mo ago
pythonSeeded, unreviewedwritten 2mo ago
Licence
MITSynced from sourceCurrent3h ago
Apache-2.0Synced from sourceCurrent3h ago
MITSynced from sourceCurrent3h ago
Archived
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
noSynced from sourceCurrent3h ago
Category
structured-outputSeeded, unreviewedwritten 2mo ago
evaluationSeeded, unreviewedwritten 2mo ago
structured-outputSeeded, unreviewedwritten 2mo ago
Contributors
268Synced from sourceCurrent3h ago
348Synced from sourceCurrent3h ago
658Synced from sourceCurrent3h ago
Forks
1360Synced from sourceCurrent3h ago
2177Synced from sourceCurrent3h ago
3127Synced from sourceCurrent3h ago
Maintainer
567 LabsSeeded, unreviewedwritten 2mo ago
Confident AISeeded, unreviewedwritten 2mo ago
PydanticSeeded, unreviewedwritten 2mo ago
Open issues
11Synced from sourceCurrent3h ago
814Synced from sourceCurrent3h ago
1825Synced from sourceCurrent3h ago
PyPI downloads, monthly
27671654Synced from sourceStale2mo ago· past SLA
—
13478631Synced from sourceStale2mo ago· past SLA
PyPI downloads, weekly
13080962Synced from sourceStale2mo ago· past SLA
—
3076771Synced from sourceStale2mo ago· past SLA
PyPI package
instructorSynced from sourceCurrent3h ago
deepevalSynced from sourceCurrent3h ago
pydantic-aiSynced from sourceCurrent3h ago
PyPI released
2026-09-09T02:25:54.888746ZSynced from sourceCurrent3h ago
2026-11-04T11:29:23.499144ZSynced from sourceCurrent3h ago
2026-11-04T10:28:38.510837ZSynced from sourceCurrent3h ago
Requires Python
<4.0,>=3.9Synced from sourceCurrent3h ago
<4.0,>=3.9Synced from sourceCurrent3h ago
>=3.11Synced from sourceCurrent3h ago
PyPI version
1.17.0Synced from sourceCurrent3h ago
4.3.3Synced from sourceCurrent3h ago
2.66.0Synced from sourceCurrent3h ago
Repository
https://github.com/567-labs/instructorSynced from sourceCurrent3h ago
https://github.com/confident-ai/deepevalSynced from sourceCurrent3h ago
https://github.com/pydantic/pydantic-aiSynced from sourceCurrent3h ago

Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 3h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.

Change the comparison

Remove one, or open the directory to pick a different set. Up to 3 at a time.


Every figure on this site resolves to the source that reported it, the moment it was observed, and how it was measured. A value that fails validation is withheld rather than shown — withheld means we refused to publish it, not that it is zero.