الأداء التفاضلي للفقرة في استبانة قياس رأي الطلبة حول المناهج السريرية في جامعة حضرموت باستخدام نموذج التقدير الجزئي

أ.م.د/ محمد حاتم سعيد الدعيس*; شوقي أحمد علي حزام الدعيس**

doi:10.53285/artsep.v8i3.3406

Authors

Mohammed Hatem Saeed *Aldoais
Shawqi Ahmed Ali Hezam Alduais

DOI:

https://doi.org/10.53285/artsep.v8i3.3406

Keywords:

Differential Item Functioning, Partial Credit Model, Item Response Theory, Test Information Function, Opinion Survey, Clinical Curricula.

Abstract

This study aims to examine the psychometric properties of a questionnaire designed to measure students’ perceptions of the clinical curricula at the College of Medicine and Health Sciences and the College of Nursing at Hadhramout University using the Partial Credit Model (PCM). It also sought to investigate Differential Item Functioning (DIF) with respect to gender and college. A descriptive-analytical research design was employed. The questionnaire initially comprised 24 items distributed across five dimensions and was administered to a main sample of 331 students, including 175 males and 156 females, of whom 179 were enrolled in the College of Medicine and Health Sciences and 152 in the College of Nursing. Participants were selected using stratified random sampling. The findings indicated that the assumptions of the Partial Credit Model were satisfied and that the questionnaire items demonstrated good model fit, with the exception of two items that were removed due to misfit, resulting in a final 22-item questionnaire. The Test Information Function indicated a high level of measurement precision, with an estimated marginal reliability coefficient of approximately 0.96. Regarding differential item functioning, four items exhibited DIF by gender, whereas no item demonstrated DIF by college, based on the adopted effect-size criterion.

References

الثبيتي، ساعد بن سعيد. (2016). تدريج فقرات مقياس اتجاهات طلبة جامعة أم القرى نحو الإشراف الأكاديمي وفق نظرية الاستجابة للمفردة. مجلة البحث العلمي في التربية، 5(17)، 43-63. https://doi.org/10.21608/jsre.2017.10380

حمدان، عادل سمير محمد. (2025). مقارنة بين نموذجي «التقدير الجزئي» و«سلم التقدير» لمقياس الكفاءة الذاتية في الإدارة الصفية للطالب المعلم. مجلة العلوم التربوية، جامعة قطر، 25(1)، 151-176. https://doi.org/10.29117/jes.2025.0213

الدوسري، راشد حماد. (2018). استخدام طريقتي مانتل-هانزل والانحدار اللوجستي للكشف عن الأداء التفاضلي لفقرات اختبار في الرياضيات. مجلة كلية التربية، 70(2)، 241-264. https://doi.org/10.21608/MKMGT.2018.132907

علام، صلاح الدين محمود. (2005). نماذج الاستجابة للمفردة الاختبارية أحادية البعد ومتعددة الأبعاد وتطبيقاتها في القياس النفسي والتربوي. دار الفكر العربي.

العناتي، جهاد محمد. (2017). الأداء التفاضلي لفقرات اختبار الذكاء غير اللفظي 4-TONI وفقا لجنس الطالب ودخل الأسرة والمستوى التعليمي للأم. مجلة دراسات تربوية، 60، 60-72. https://doi.org/10.34118/0136-000-060-005

القرشي، خديجة ضيف الله. (2016). استخدام نموذج التقدير الجزئي في انتقاء فقرات مقياس اتجاهات طلبة الدراسات العليا نحو برنامج SPSS في منطقة مكة المكرمة. المجلة الدولية التربوية المتخصصة، 5(9)، 529-552. https://doi.org/10.12816/0036004

المسكري، هلال؛ المحرزي، راشد؛ وحسن، عبد الحميد. (2021). الأداء التفاضلي لمفردات اختبار القدرة اللفظية في مقياس الخليج للقدرات العقلية المتعددة لطلبة دول مجلس التعاون الخليجي تبعًا لمتغيري الجنس والدولة. مجلة الدراسات النفسية والتربوية، 15(1)، 120-137. https://doi.org/10.53543/jeps.vol15iss1pp120-137

الوابل، وديان؛ وتعلب، صبرين صلاح. (2023). الأداء التفاضلي لفقرات اختبار الذكاء الثلاثي تبعًا لمتغيري الجنس والتخصص لدى طلاب جامعة القصيم. مجلة الآداب للدراسات النفسية والتربوية، 5(1)، 59-102. https://doi.org/10.53285/artsep.v5i1.1378

Arabic References

Al-Thubaytī, Sāʿid ibn Saʿīd. (2016). Tadrīj faqārāt miqyās ittijāhāt ṭalabat Jāmiʿat Umm al-Qurá naḥw al-ishrāf al-akādīmī wafqan li-naẓariyyat al-istijābah lil-mufradah. Majallat al-Baḥth al-ʿIlmī fī al-Tarbiyah, 17(5), 43–63. https://doi.org/10.21608/jsre.2017.10380

Ḥamdān, ʿĀdil Samīr Muḥammad. (2025). Muqāranah bayna namūdhajay «al-taqdīr al-juzʾī» wa«sullam al-taqdīr» li-miqyās al-kafāʾah al-dhātiyyah fī al-idārah al-ṣaffiyyah lil-ṭālib al-muʿallim. Majallat al-ʿUlūm al-Tarbawiyyah, Jāmiʿat Qaṭar, 25(1), 151–176. https://doi.org/10.29117/jes.2025.0213

Al-Dawsarī, Rāshid Ḥammād. (2018). Istikhdām ṭarīqatay Mantel-Haenszel wa-al-inḥidār al-lūjistī li-l-kashf ʿan al-adāʾ al-tafāḍulī li-faqārāt ikhtibār fī al-riyāḍiyyāt. Majallat Kulliyyat al-Tarbiyah, 70(2), 241–264. https://doi.org/10.21608/MKMGT.2018.132907

ʿAllām, Ṣalāḥ al-Dīn Maḥmūd. (2005). Namādhij al-istijābah lil-mufradah al-ikhtibāriyyah uḥādiyyat al-buʿd wa-mutaʿaddidat al-abʿād wa-taṭbīqātuhā fī al-qiyās al-nafsī wa-al-tarbawī. Dār al-Fikr al-ʿArabī.

Al-ʿAnātī, Jihād Muḥammad. (2017). Al-adāʾ al-tafāḍulī li-faqārāt ikhtibār al-dhakāʾ ghayr al-lafẓī 4-TONI wafqan li-jins al-ṭālib wa-dakhl al-usrah wa-al-mustawá al-taʿlīmī lil-umm. Majallat Dirāsāt Tarbawiyyah, 60, 60–72. https://doi.org/10.34118/0136-000-060-005

Al-Qurashī, Khadījah Ḍayf Allāh. (2016). Istikhdām namūdhaj al-taqdīr al-juzʾī fī intiqāʾ faqārāt miqyās ittijāhāt ṭalabat al-dirāsāt al-ʿulyā naḥw barnāmaj SPSS fī minṭaqat Makkah al-Mukarramah. Al-Majallah al-Dawliyyah al-Tarbawiyyah al-Mutakhaṣṣiṣah, 5(9), 529–552. https://doi.org/10.12816/0036004

Al-Maskarī, Hilāl; al-Muḥrizī, Rāshid; wa-Ḥasan, ʿAbd al-Ḥamīd. (2021). Al-adāʾ al-tafāḍulī li-mufradāt ikhtibār al-qudrah al-lafẓiyyah fī miqyās al-Khalīj lil-qudarāt al-ʿaqliyyah al-mutaʿaddidah li-ṭalabat Duwal Majlis al-Taʿāwun al-Khalījī tabaʿan li-mutaghayyiray al-jins wa-al-dawlah. Majallat al-Dirāsāt al-Nafsiyyah wa-al-Tarbawiyyah, 15(1), 120–137. https://doi.org/10.53543/jeps.vol15iss1pp120-137

Al-Wābil, Widyān; wa-Taʿlab, Ṣabrīn Ṣalāḥ. (2023). Al-adāʾ al-tafāḍulī li-faqārāt ikhtibār al-dhakāʾ al-thulāthī tabaʿan li-mutaghayyiray al-jins wa-al-takhaṣṣuṣ ladá ṭullāb Jāmiʿat al-Qaṣīm. Majallat al-Ādāb lil-Dirāsāt al-Nafsiyyah wa-al-Tarbawiyyah, 5(1), 59–102. https://doi.org/10.53285/artsep.v5i1.1378

ثانياً: المراجع الإنجليزية

Alanazi, N. H. (2025). Clinical Learning Environment, Supervision, and Nurse Teacher Evaluation (CLES + T) Scale: Saudi Arabic version—A cross-sectional validation study of nursing interns and students. Journal of Nursing Management, 2025, Article 4483497. https://doi.org/10.1155/jonm/4483497

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561-573. https://doi.org/10.1007/BF02293814

Baker, F. B. (2001). The basics of item response theory (2nd ed.). ERIC Clearinghouse on Assessment and Evaluation.

Baker, F. B., & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques (2nd ed.). Marcel Dekker.

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.

Boyd, M. P., Callaghan, J. E., Knight, C. J., & Crocker, P. R. E. (2014). Identifying differential item functioning of rating scale items with the Rasch model: An introduction and an application. Measurement in Physical Education and Exercise Science, 18(2), 100-115. https://doi.org/10.1080/1091367X.2014.893089

Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased test items. Sage Publications.

Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102_10

Chan, D. S. K. (2002). Associations between student learning outcomes from their clinical placement and their perceptions of the social climate of the clinical learning environment. International Journal of Nursing Studies, 39(5), 517–524. https://doi.org/10.1016/S0020-7489(01)00057-8

Chang, H.-H., Mazzeo, J., & Roussos, L. (1996). Detecting DIF for polytomously scored items: An adaptation of the SIBTEST procedure. Journal of Educational Measurement, 33(3), 333–353. https://doi.org/10.1111/j.1745-3984.1996.tb00496.x

DeMars, C. E. (2005). Type I error rates for PARSCALE’s fit index. Educational and Psychological Measurement, 65(1), 42–50. https://doi.org/10.1177/0013164404264849

Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates.

Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272

Fan, C.-W., Chang, K.-C., Lee, K.-Y., Yang, W.-C., Pakpour, A. H., Potenza, M. N., & Lin, C.-Y. (2022). Rasch modeling and differential item functioning of the self-stigma scale-short version among people with three different psychiatric disorders. International Journal of Environmental Research and Public Health, 19(14), Article 8843. https://doi.org/10.3390/ijerph19148843

Guilford, J. P., & Fruchter, B. (1973). Fundamental statistics in psychology and education (5th ed.). McGraw-Hill.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage.

Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Kluwer-Nijhoff.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Sage.

Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Lawrence Erlbaum Associates.

Hur, Y., & Seo, D. G. (2023). Development of a character qualities test for medical students in Korea using polytomous item response theory and factor analysis: A preliminary scale development study. Journal of Educational Evaluation for Health Professions, 20, 20. https://doi.org/10.3352/jeehp.2023.20.20

Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/BF02291575

Keeves, J. P., & Alagumalai, S. (1999). New approaches to measurement. In G. N. Masters & J. P. Keeves (Eds.), Advances in measurement in educational research and assessment (pp. 23–42). Pergamon.

Kim, S.-H., & Cohen, A. S. (1995). A comparison of Lord's chi-square, Raju's area measures, and the likelihood ratio test on detection of differential item functioning. Applied Measurement in Education, 8(4), 291–312. https://doi.org/10.1207/s15324818ame0804_2

Kim, S.-H., & Cohen, A. S. (1998). Detection of differential item functioning under the graded response model with the likelihood ratio test. Applied Psychological Measurement, 22(4), 345–355. https://doi.org/10.1177/014662169802200403

Lawson, D. M., & Brailovsky, C. (2006). The presence and impact of local item dependence on objective structured clinical examinations scores and the potential use of the polytomous, many-facet Rasch model. Journal of Manipulative and Physiological Therapeutics, 29(8), 651–657. https://doi.org/10.1016/j.jmpt.2006.08.002

Leis, M., Schmidt, K., & Kaufman, S. (2015). Using the partial credit model to evaluate the student engagement in mathematics scale. Journal of Applied Measurement, 16(3), 251-267.

Linacre, J. M. (1998). Detecting multidimensionality: Which residual data-type works best? Journal of Outcome Measurement, 2(3), 266-283.

Linacre, J. M. (2012). A user's guide to Winsteps Rasch-model computer programs. Winsteps.com.

Linacre, J. M. (2024). Winsteps® Rasch measurement computer program user's guide. Winsteps.com.

Liu, Y., Lin, Z., & Wang, X. (2023). Gender-based differential item function for the positive and negative semantic dimensions of the relationship satisfaction scale with item response theory. Behavioral Sciences, 13(10), 825. https://doi.org/10.3390/bs13100825

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum Associates.

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174. https://doi.org/10.1007/BF02296272

McDonald, R. P. (1978). Generalizability in factorable domains: Domain validity and generalizability theory. Educational and Psychological Measurement, 38(1), 75–79. https://doi.org/10.1177/001316447803800111

McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum Associates.

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). American Council on Education/Macmillan.

Na, M., Gross, A. L., & West, K. P., Jr. (2015). Validation of the food access survey tool to assess household food insecurity in rural Bangladesh. BMC Public Health, 15, 863. https://doi.org/10.1186/s12889-015-2215-z

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.

Raju, N. S., van der Linden, W. J., & Fleer, P. F. (1995). IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19(4), 353–368. https://doi.org/10.1177/014662169501900405

Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4(3), 207–230. https://doi.org/10.3102/10769986004003207

Roff, S., McAleer, S., Harden, R. M., Al-Qahtani, M., Ahmed, A. U., Deza, H., Groenen, G., & Primparyon, P. (1997). Development and validation of the Dundee Ready Education Environment Measure (DREEM). Medical Teacher, 19(4), 295-299. https://doi.org/10.3109/01421599709034208

Saarikoski, M., & Leino-Kilpi, H. (2002). The clinical learning environment and supervision by staff nurses: Developing the instrument. International Journal of Nursing Studies, 39(3), 259–267. https://doi.org/10.1016/S0020-7489(01)00031-1

Smith, E. V., Jr. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.

Strand, P., Sjöborg, K., Stalmeijer, R., & Wichmann-Hansen, G. (2013). Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM). BMC Medical Education, 13, 117. https://doi.org/10.1186/1472-6920-13-117

Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 147–169). Lawrence Erlbaum Associates.

Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. MESA Press.

Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense (Canada).

Zumbo, B. D. (2007). Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly, 4(2), 223-233. https://doi.org/10.1080/15434300701375832