Association for Behavior Analysis International

The Association for Behavior Analysis International® (ABAI) is a nonprofit membership organization with the mission to contribute to the well-being of society by developing, enhancing, and supporting the growth and vitality of the science of behavior analysis through research, education, and practice.


41st Annual Convention; San Antonio, TX; 2015

Event Details

Previous Page


Paper Session #229a
Paideia Individualized Education Technology
Sunday, May 24, 2015
4:00 PM–4:20 PM
209 (CC)
Area: EDC
Keyword(s): Paideia, PIE
Chair: Francis Mechner (The Mechner Foundation)
A Teacher Consensus Method for Achieving Reliability in Assessing Non-Academic Competencies
Domain: Applied Research
FRANCIS MECHNER (The Mechner Foundation), Tim Fredrick (Queens Paideia School), Laurilyn Dianne Jones (The Mechner Foundation)
Abstract: The Paideia Individualized Education technology places equal emphasis on academic and non-academic competencies. 17 non-academic competencies, covering social interaction, self-management, and learning skills are assessed and tracked by means of teachers' ratings. The research being reported demonstrates a method for overcoming the unreliability of such ratings. Five teachers, each of whom had daily individualized contact with each of the students, rate every student on a ten-point scale for each of the 17 categories of non-academic competency. The five ratings for each competency for each student are then averaged and analyzed statistically to determine the probability that the ratings were due only to chance. A consensus average rating is said to exist when the probability that the five ratings are due to chance is less than 5%. Validity is thus based on a consensus of multiple independent observers When the ratings of a category for a student do not reflect a statistical consensus, the definition of the category is considered inadequate for a reliable assessment of that category, the category is considered unsatisfactory. This consensus-based method of assessment is made possible by the PIE technology's team approach, in which several teachers have daily contact with every student. The results of applying this assessment method will be presented.
Keyword(s): Paideia, PIE



Back to Top
Modifed by Eddie Soh