AI Learning Apps: How to Check a Claim With ESSA Evidence Tiers

No learning app can be called the top one without evidence. How the four ESSA evidence tiers and a short checklist test an app's claims.

Guide: AI BasicsLast verified: October 20265 min read

No single AI learning app can be named the top one on the evidence available, because ranking lists rarely say what was measured, for whom, or against what comparison. A more reliable method borrows the four evidence tiers that United States federal education law uses: strong evidence from experimental studies, moderate from quasi-experimental studies, promising from correlational studies with statistical controls, and a documented rationale with ongoing evaluation. Applying that ladder to any app's claims shows quickly how much support they have.

Key takeaways

  • The Every Student Succeeds Act (ESSA) defines "evidence-based" in 20 U.S.C. 7801(21) with three study-based tiers and a fourth tier built on a rationale plus ongoing evaluation.
  • An app's own usage statistics or user ratings do not fit any of the study-based tiers unless a comparison group and statistical controls are involved.
  • A rationale, such as a described learning theory, is the weakest tier and must come with efforts to examine effects.
  • Canadian education is mainly a provincial and territorial responsibility, and no national equivalent of the ESSA tiers was confirmed for this article.

Why "top app" lists do not answer the question

Lists of the best learning apps usually mix download counts, editor opinions, and feature checklists. None of these show whether a learner who used the app knew more afterward than a similar learner who did not. The question that matters for skill-building, such as learning to work with AI tools or understand how models behave, is the comparison: more learning than what, measured how, over what time.

A federal statute is a useful yardstick here because it was written to separate strong claims from weak ones. It was written for school and district purchasing decisions, but its logic applies to any learner or teacher weighing an app.

The four ESSA evidence tiers

Section 8101(21) of the Elementary and Secondary Education Act, as amended by ESSA and codified at 20 U.S.C. 7801, defines an evidence-based activity, strategy, or intervention as one that demonstrates a statistically significant effect on improving student outcomes or other relevant outcomes. The statute names three levels of support for that effect: strong evidence from at least one well-designed and well-implemented experimental study, moderate evidence from at least one well-designed and well-implemented quasi-experimental study, and promising evidence from at least one well-designed and well-implemented correlational study with statistical controls for selection bias.

The statute also offers an alternative route. An intervention can qualify if it demonstrates a rationale based on high-quality research findings or positive evaluation that it is likely to improve outcomes, and it includes ongoing efforts to examine its effects. For certain activities funded under section 6303, only the three study-based levels count.

Applying the tiers to an app's claims

The table maps common kinds of claims to the tier they could support. It is an illustrative reading, not an official rating, and the label depends on how well a study is designed and carried out.

Type of claimClosest ESSA tierQuestion to ask
Learners were randomly assigned to the app or to a comparison condition, and outcomes were testedStrong (experimental)Was the study well implemented, and does the group resemble the intended learners?
Learners using the app were matched with similar learners who did not, without random assignmentModerate (quasi-experimental)How was the match made, and could unmeasured differences explain the result?
App users who spent more time did better, with statistical controlsPromising (correlational)Do the controls address selection bias, such as more motivated learners choosing more practice?
The design follows a described learning theoryRationaleIs the theory backed by research, and is anyone evaluating effects?
High ratings, testimonials, or download countsNone of the tiersWhat was compared, and what outcome was measured?

A checklist for judging a learning app

  • Find the study behind any "proven" claim and read who ran it and who paid for it.
  • Check that the outcome is learning (a test or task) and not engagement (minutes used, streaks, completion).
  • Look for a comparison group and how it was formed.
  • Check whether learners in the study resemble the intended user, in age, prior knowledge, and setting.
  • Note the size and length of the study; a short trial with few participants supports a modest claim.
  • Read the privacy terms before entering a learner's data, especially for children.
  • Prefer sources that publish limits, not only successes.

For learning about AI itself, free university course materials and open syllabi can serve as an alternative to a paid app, and the same checklist applies to them. The point of the exercise is to match the strength of the claim to the strength of the evidence. A modest claim with a documented rationale is acceptable if it is presented as such.

Limits of this approach

The ESSA tiers define what counts as evidence-based for federal education funding, and the statute does not rate individual products. States and districts interpret the tiers in practice, and a study that meets a tier in one context may not transfer to another. This article does not review or recommend any specific app, and it does not rate any provider. Canadian readers should note that education there is mainly a provincial and territorial responsibility, so purchasing and privacy rules for schools vary by jurisdiction. This is general information, not legal or professional advice.

FAQ

Is there an official list of approved AI learning apps?

None was found for this article. The federal statute defines what counts as evidence-based but does not certify products.

Do ESSA tiers apply to adults learning on their own?

They do not apply legally, since the statute concerns school funding. The reasoning about study design still helps anyone judge a claim.

What is the difference between an experimental and a quasi-experimental study?

An experimental study assigns participants to groups at random. A quasi-experimental study compares groups that were formed without random assignment, so differences between the groups can affect the result.

Does a high rating in an app store count as evidence?

It does not fit the tiers on its own. A rating reflects user satisfaction, not a measured difference in learning against a comparison group.

Last verified: October 2026

Sources

  • Education in Canada: An Overview, Council of Ministers of Education, Canada, 2026
  • 20 U.S.C. 7801, definitions, paragraph (21) "Evidence-based," Elementary and Secondary Education Act as amended by the Every Student Succeeds Act, 2015

New to artificial intelligence?

Start with the basics, then follow the guides to tools, rules, and effects on society.

Start with AI Basics