<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=1713097408989292&amp;ev=PageView&amp;noscript=1">

Third Party Validation

We Believe in Accountability and Transparency

 

ST Math meets WWC and ESSA Tier 2 requirements:

Third-Party Validation of ST Math Quasi-Experimental Study, read more below

ST Math Randomized Controlled Trial, read more on the IES What Works Clearinghouse

These join more than 100 studies on the efficacy of ST Math, including other third-party studies, MIND's own quasi-experimental studies across states and years, and MIND's subgroup studies.

WestEd recently published the largest study of its kind to evaluate an education technology math program nationally, including over 150,000 students between 2013 and 2016. This national-level study expands upon previously published WestEd independent validations of the effectiveness of ST Math at the district level (Los Angeles Unified School District 2013) and statewide (California 2014).

The study looked at grades 3, 4 and 5 in 474 schools that started using ST Math between 2013 and 2015, and included 16 states where complete state standardized test and demographic data was publicly available to the researchers.

LAUSD in 2013
45 Schools
9,000 Students
Grades 2-5
California in 2014
129 Schools
19,980 Students
Grades 2-5
Nationwide in 2018
474 Schools
80,000 Students
Grades 3-5

The results were especially significant at the 239 schools that used ST Math consistently (where more than 85% of students used the program and on average completed 50% of their grade-level content during the year). These high fidelity schools showed significant growth.

WestEd States
WestEd Students
WestEd Schools and Districts
Download Infographic

What are the key findings?

Schools that consistently used ST Math outgrew similar schools in statewide rank by 14 percentile points.

WestEd Graph

ST Math’s Effect Size

When looking at the percent of students in one grade who achieved math proficiency on their state test at a given school, ST Math had an average effect size of 0.36 on statewide ranking (z-score). As a reference point, the federal What Works Clearinghouse defines 0.25 effect size and above as “substantively important.”

WestEd Effect Size
Download Newest WestEd Report

SRI International Provides Third-Party Validation of the ST Math WestEd Study

 

A first-of-its-kind independent review validating nonprofit research center WestEd’s study of ST Math® to federal evaluation research standards was published by nonprofit, research center SRI International. The review determined that the 2018 WestEd study on ST Math meets Every Student Succeeds Act (ESSA) Tier 2 and What Works Clearinghouse (WWC) standards.

Why Validate the Findings? 

At MIND, we believe that ESSA Tier claims about program effectiveness should be based on rigorous and transparent evidence and on independent review. That’s why we developed a scalable, repeatable, high volume evaluation methodology; asked WestEd to perform and validate the method and report results; and asked SRI to formally review WestEd’s study to specific federal requirements.

The 2018 nationwide WestEd study was a breakthrough in effectiveness evidence for ST Math, as the size was at last sufficient to earn all the significance asterisks for our novel studies. What’s novel is we’re reporting out results on the highest stakes metric in the education market: school-wide performance improvement from year to year.

SRI’s third-party evaluation of the WestEd study to federal specifications provides an extra layer of scrutiny and accountability. There is currently no requirement for edtech ESSA evidence claims to be third-party validated, but MIND has put that requirement on ourselves because we believe full transparency to be so vital to improving the health of the education market.

What Did SRI Find?

SRI completed a technical review of the 2018 WestEd study against the WWC v4.0 Group Design Standards & Procedures. SRI concluded that the WestEd ST Math study design “meets the design, analytic, and technical requirements” for the ‘Meets Evidence Standards with Reservations’ level of the WWC standards.

SRI also reviewed the WestEd study design against ESSA levels of evidence provided by the U.S. Department of Education. SRI concluded the study design meets ESSA Tier 2, as it “fulfills the requirements of moderate evidence of significant favorable effects of ST Math on student mathematics achievement.”

Read the SRI Review  Read the Press Release

Albemarle_Logo.png
"I’m encouraged to see that ST Math continues to show significant effects on math achievement. But I’m even more impressed with the breadth of ST Math evaluations towards evaluating every school, every year, which provide a model for other education technology companies to follow."
Tonika Cheek Clayton
Managing Partner at New Schools Venture Fund
See for yourself why students and educators across the country are taking a radically different approach to math.
Request Demo