ST Math Methodology & Impact

    A New Paradigm for EdTech Evaluation

    In the current edtech landscape, we rarely look beyond the one “gold standard” study for proof that a program is effective -- even if it’s many years old and only covers a single assessment. Here at MIND, we encourage everyone to raise their sights and look for a large number of studies, using recent program versions, garnering repeatable results on multiple state assessments, and over many varied districts. We believe a high volume of effectiveness studies is the future of a healthy market for product information in education.
    ipad-rigor-ebook.png

    Program Evaluation Rubric

    DOWNLOAD FREE RUBRIC

    ST Math Methodology

    What is Z-Score?
    In order to compare changing state assessments year to year, we calculate z-scores for every grade across all years being analyzed, using full state data set of schools for the averages and standard deviations.

    The use of z-scores is a valid statistical method to normalize any dataset and enable analysis across otherwise uncomparable exams. All of our reports include both mean scale scores and their accompanying z-scores.
    close-button

    Compared to lengthy, expensive RCTs (randomized controlled trials), organic quasi-experiments can study the adoption of a program as is, without the length and complexity of experiment planning. Methods of matching and comparing similar schools with and without the program can be made statistically rigorous and powerful. And if we study at the grade-level, we have the average state test performance data universally available. This is how we perform multiple annual, transparent evaluations of results of all ST Math school cohorts.

    States Studied Per Year

    since 2011

    120 studies across 27 states since 2011.

    *Some states had multiple studies within a calendar year

    See Your State Analysis
    The Importance of Effect Size

    Independent education research firm WestEd recently conducted a study of 3rd to 5th grades in more than 450 schools and 16 states. In the 14 states with schools that consistently implemented ST Math, the average effect size for math proficiency was .36, well above what is considered “substantively important" by the federal What Works Clearinghouse.

    See WestEd Results

    Data and Evaluation Support

    andrew-coulson
    Andrew Coulson
    Chief Data Science Officer, MIND
    Getting reliable educational outcome metrics from your ST Math program requires data about usage inputs, program outputs and outcomes, and state test score outcomes. All this information and insight is crucial when you’re looking to measure long-lasting impact.

    That’s why MIND Research Institute’s Data and Evaluation team is dedicated to helping you uncover granular usage data while creating innovative visualizations and actionable reports to supercharge your evaluations.
    Experience the power of visual learning with a free personalized demo of ST Math®.
    Request Demo
    Copyright © 2023 MIND Education. All rights reserved.