March 21, 2003
Re: Two Well Controlled Experimental Studies that Meet the Federal Guidelines for Evidence Guided Educational Decisions.
Study One-Accelerated Reader vs Non-Accelerated Reader
Study Two-Effect of Increased Individual Reading Time on Reading Achievement

From: Jay Samuels

I am a professor of educational psychology in the College of Education at the University of Minnesota. As a member of the National Reading Panel I co-authored the section on reading fluency, and for seven years was the co-editor of the Reading Research Quarterly, which is published by the International Reading Association. IRA has given me its Wm. S. Gray Research Award and the National Reading Conference awarded me its Oscar Causey Research Award. My reason for listing these awards is to let you know that my background is in reading and as a member of the scientific arm of the National Reading Panel I have an excellent idea about what the government is requiring with regard to evidence based decision-making. The two studies I am summarizing meet the government guidelines and I found some interesting results.
Both studies were done at Hayden Heights Elementary School in St. Paul, Minnesota. The ethnicity of this K-6 school is 57% minority (Hmong, African-Americans, and Hispanic) and 43% Caucasian. All the students receive free breakfast and the achievement level of the school is below the average for the state on the statewide assessment.
The research design for the Accelerated Reader vs. the Non-Accelerated Reader used a 2 x 2 x 2 design in which there were two grade levels (Grades 3 and 5), an experimental condition and a control condition, and students were divided into two reading levels. We randomly assigned the Accelerated Reader condition and the Non-Accelerated Reader control condition to teachers and the teachers had assigned students to classes in such a way that the classes were balanced with regard to achievement.
Both the Accelerated Reader and the Non-Accelerated classes had exactly the same amount of time (15 minutes) allocated to in-class individual, silent reading of books, as well as the same amount of time (15 minutes) that the teacher read books aloud to them. In addition, all the students received reading instruction during their 60 minutes language arts block. Students in the Accelerated Reader condition and students in the Non-Accelerated Reader condition had access to books in the school library that were color coded to represent zones of proximal development where the students could read at an appropriate level for their ability. All the students in the study took the Star Reading Test. This test diagnosed the student’s reading skill level and designated a zone of proximal development for each student. This zone represents a readability level that is appropriate for the student so that the text matches the student’s skill level and would still allow reading achievement growth.
The experimental Accelerated Condition followed recommended procedures. Students took the Star test and were assigned zones of proximal development so they could select books at the library that were appropriate for their reading level. Students were encouraged to read the books carefully so as to get quiz scores that averaged 85% or higher. After reading a book, students in the Accelerated Reader condition took a quiz on the book.
The control non-accelerated reader students also took the Star test and the teachers had access to the scores of the students but the teachers had the discretionary power to have students read at their zone but it was not mandated. When the students in the control Non-Accelerated Reader condition finished reading a book they did not take a computerized quiz. In essence, the non-accelerated reader condition mirrored what happens in regular classroom where students are encouraged to read and they do not take a quiz on the books they have completed.
All the students in the study, regardless of condition, were pretested and posttested after ten weeks. Our dependent variable was the gain score. We found that the Accelerated Reader students made 21 weeks of gain and the non-accelerated reader condition made only 9 weeks of gain as measured by the sentence comprehension test on the GRADE Reading Test. On the GRADE passage comprehension and the vocabulary tests, again the Accelerated Reader condition outperformed the non-accelerated condition by a factor of at least 3 to 1, that is, for every month of gain that the control condition made, the experimental students made three months of gain. We also found that the differences were statistically significant. There was one more important finding. When the less good readers who used the Accelerated Reader were compared to the less good readers who were not using the Accelerated Reader, we found the Accelerated Reader low readers significantly outperformed the control students.
Conclusion? In a tightly controlled experimental study, the students who were using the Accelerated Reader made significant gains in comprehension and vocabulary in comparison to students who were not using this system by a factor of about 3 to 1, that is, for every month of gain made by the control condition the experimental condition gained three months. Furthermore, the Accelerated Reader system was especially useful for the less good readers. These positive results in comprehension and vocabulary resulted from fifteen minutes of reading that was motivated and supported by a software system that motivated students to read books that matched their level of reading skill with great care.

Study Two-Effect of Increased Individual Reading Time on Reading Achievement.
This experimental study investigated achievement gains for students who read silently for 40 minutes in contrast to students who read silently for only 15 minutes. Students were randomly assigned to conditions. All the teachers and the students followed accepted Accelerated Reader procedures. We found that the students who read for 40 minutes significantly outperformed the students who read for 15 minutes on a variety of tests such as the Star test of reading ability, speed of reading as measured by Curriculum Based Measurement, and word recognition. Other studies that found more time spent reading were associated with greater gains used correlational designs where one could not pin-point cause and effect. What was unique about this study was that we used an experimental design where we could assign causality, namely that time spent in reading led to the achievement gains. This study demonstrated Mathew Effects in reading, that is, those who spent more time reading prospered the most.


The views and opinions expressed in this page are strictly those of the page author.
The contents of this page have not been reviewed or approved by the University of Minnesota.