|
| Paideia Individualized Education Technology |
| Sunday, May 24, 2015 |
| 4:00 PM–4:20 PM |
| 209 (CC) |
| Area: EDC |
| Keyword(s): Paideia, PIE |
| Chair: Francis Mechner (The Mechner Foundation) |
| |
| A Teacher Consensus Method for Achieving Reliability in Assessing Non-Academic Competencies |
| Domain: Applied Research |
| FRANCIS MECHNER (The Mechner Foundation), Tim Fredrick (Queens Paideia School), Laurilyn Dianne Jones (The Mechner Foundation) |
| |
| Abstract: The Paideia Individualized Education technology places equal emphasis on academic and non-academic competencies. 17 non-academic competencies, covering social interaction, self-management, and learning skills are assessed and tracked by means of teachers' ratings. The research being reported demonstrates a method for overcoming the unreliability of such ratings. Five teachers, each of whom had daily individualized contact with each of the students, rate every student on a ten-point scale for each of the 17 categories of non-academic competency. The five ratings for each competency for each student are then averaged and analyzed statistically to determine the probability that the ratings were due only to chance. A consensus average rating is said to exist when the probability that the five ratings are due to chance is less than 5%. Validity is thus based on a consensus of multiple independent observers When the ratings of a category for a student do not reflect a statistical consensus, the definition of the category is considered inadequate for a reliable assessment of that category, the category is considered unsatisfactory. This consensus-based method of assessment is made possible by the PIE technology's team approach, in which several teachers have daily contact with every student. The results of applying this assessment method will be presented. |
| |
| Keyword(s): Paideia, PIE |
|
| |