Data Analysis and Evaluation

Program Evaluation is an essential part of the Instructional Design process. Examining a new or existing program to see what’s working and what’s not allows for continuous improvement to streamline the learning process and ensure that the goal of the learning program is being met.

Below is an example of a program analysis I created for a 6-12 private school in Ohio on the effectiveness of a remediation program that they already had in place. They were using Edmentum to try and bridge learning gaps with the goal of increasing NWEA testing scores in their middle school (grades 6-8) students. I designed a four step evaluation process geared specifically towards examining the effectiveness of the Edmentum program in that school with that group of students.

Below is the full program analysis including the data collected and examined. To summarize, using the Kirkpatrick Model of Evaluation I analyzed data from students, teachers, as well as Edmentum reports and NWEA test scores from the past two years. I found that the overall reaction to Edmentum from both teachers and students was incredibly negative. I also found that Edmentum did not appear to having any effect on increasing NWEA scores, both within the same school year and from one school year to the next. My recommendation was that Edmentum was not an effective tool for remediation, but could have potential in continued practice when not in a face-to-face setting with a teacher, for example to combat “summer slide”.