Delphi method Stage 3 Assessment activity The assessment results
المؤلف:
Gipsy Chang & Josephine Csete
المصدر:
Enhancing Teaching and Learning through Assessment
الجزء والصفحة:
P462-C38
2025-08-25
307
Delphi method
Stage 3 Assessment activity
The assessment results
In total 23 videos were assessed by 3 assessors. After watching each video, the assessors evaluated and graded the performance of each item. After the assessment, the data was analyzed through statistical tests to find out the reliability coefficient and inter reliability among assessors, students, and the assessment items.
Firstly, the reliability coefficient of all samples and items was calculated. The result is:
Alpha = .9864
This implies that the tendency of scores of each video project is similar, indicating videos receiving high scores in one item were also likely to receive high scores in other items. If a student video project is seen as creative, it is creative in most aspects, rather than good at one single area and poor in the others.
Secondly, the inter reliability of the 3 assessors was tested. The result is:
Alpha = .9261
This means video scoring high marks from one assessor usually also scored high marks from the other two assessors.
The third test was the inter reliability of different categories by individual assessor:
Assessor 1: Alpha = .9751
Assessor 2: Alpha = .9691
Assessor 3: Alpha = .9748
This implies scores given by each assessor in different categories are very close. That is to say, if an assessor grades high on the content items, he/she is also likely to give high marks in other categories.
الاكثر قراءة في Assessment
اخر الاخبار
اخبار العتبة العباسية المقدسة
