82 | Chapter 3 Appendix B Interrater reliabilities (IRR) of the different items of the codebook using Krippendorff’s alpha and percentage of agreement. Item IRR measurement 1 n=24 IRR measurement 2 n=10 IRR measurement3 n=20 General 1. Sex 1.0 – 100% 1.0 – 100% 1.0 – 100% 1. Institute 1.0 – 100% 1.0 – 100% 1.0 – 100% 1. Year of training 1.0 – 100% 1.0 – 100% 0.94 – 95% 2. Year of rating 1.0 – 100% 1.0 – 100% 1.0 – 100% 3. Completed forms 0.98 – 50% 1.0 – 100% 0.99 – 90% Reflection 4. Presence 0.41 – 54.2% 1.0 – 100% 0.67 – 85% 5. Level 0.76 – 83.3% 1.0 – 100% 0.84 – 80% Feedback Teachers 6. Medical Expert 0.85 – 70.8% 0.75 – 90% 1.0 – 100% 6. Communicator 1.0 – 100% 1.0 – 100% 1.0 – 100% 6. Collaborator 1.0 – 100% 1.0 – 100% 1.0 – 100% 6. Leader 0.65 – 75% 1.0 – 100% 1.0 – 100% 6. Health Advocate 0.88 – 75% 1.0 – 100% 1.0 – 100% 6. Scholar 0.85 – 75% 1.0 – 100% 1.0 – 100% 6. Professional 1.0 – 100% 0.63 – 90% 1.0 – 100% 6. None 1.0 – 100% 1.0 – 100% 1.0 – 100% 7. Specificity 0.73 – 70.8% 1.0 – 100% 1.0 – 100% 8. Focus 0.48 – 66.7% 1.0 – 100% 0.78 – 85% 9. Purpose 0.66 – 66.7% 0.42 – 70% 0.70 – 85% 10. Source 0.29 – 54.2% 1.0 – 100% 0.70 – 85% 11. Level 0.61 – 70.8% 1.0 – 100% 0.0 – 100% Feedback Supervisor 12. Medical Expert 0.45 – 54.2% Eliminated Eliminated 12. Communicator 0.13 – 33.3% Eliminated Eliminated 12. Collaborator 0.44 – 50% Eliminated Eliminated 12. Leader 0.18 – 50% Eliminated Eliminated 12. Health Advocate 0.13 – 50% Eliminated Eliminated 12. Scholar 0.18 – 50% Eliminated Eliminated 12. Professional 0.11 – 37.5% Eliminated Eliminated
RkJQdWJsaXNoZXIy MjY0ODMw