Scientifically Based Research

KnowledgeQuest is a recognized and proven objective third party that has been performing scientifically based research (SBR) together with Empirical Education, Inc. since the federal legislation took effect. Our clients benefit from our experience because:

• We know the pitfalls of education research generally and scientifically based research in particular. We know how to avoid these pitfalls, so our clients save time and money.
• Our research is empirical, meeting the Department of Education's "Gold Standard" of efficacy testing for federal and state requirements.

1. Randomized Controlled Trials (RCTs)

We conduct these within a school district with between 30 to 40 teachers who volunteer to implement the new product and are then randomly assigned to piloting the product or continuing to use their current program. Random assignment is recognized throughout the scientific community as the only way to produce unbiased results.  We work with the school district to obtain access to student records and to conduct additional testing (when the routine state or district testing is not sufficient).

We monitor the teachers and classrooms through interviews, observations and web-based surveys. Statistical analyses of the results rely on state-of-the-art methods.  These studies can be combined with formative elements allowing products to be improved while in the process of testing.  Often a set of such RCTs are conducted in different districts representing different populations and markets.

2. Longitudinal RCTs

These are RCTs that extend into a second or third year following the same teachers and often the same students.  These studies are important where teacher and student experience with the intervention is expected to result in continuing gains over time.  These are structured so that results are available after the first year.  

• We also offer Quasi-experimental Studies for products that require less rigorous standards of efficacy. This kind of study is conducted in a district that has partially implemented the product. By matching schools, teachers and classrooms that are using the product with very similar schools, teachers and classrooms, we can estimate the difference that the new program made. 
• What Works Clearinghouse Intervention Study is a very structured review of the research literature using the selection and analysis procedures of the WWC.  Where possible, the review will calculate an effect size that summarizes the quantitative conclusions of the qualified studies.
  
• A Data Mining Study helps clients in analyzing their existing data to detect an impact of the product.  Such studies can be very useful as preliminary investigations and for providing customers with evidence of local effectiveness.
  
• We can bolster product credibility with White Papers delineating the research bases of products.
• We conduct Best Practices studies that can serve as a sound basis for recommendations to decision-makers.

In addition to delivering scientifically-based research, KnowledgeQuest and Empirical Education work with clients to better understand the impact that these research studies can have on marketing and sales productivity.