ANALYSIS AND RESULTS: CONFIRMATORY FACTOR ANALYSIS THE MALAY VERSION OF DREEM INVENTORY WITH MEDICAL STUDENTS OF UNISZA, KUALA TERENGGANU, MALAYSIA
DOI:
https://doi.org/10.22159/ajpcr.2017.v10i12.21931Keywords:
Confirmatory factor analysis, Malay version of DREEM, MalaysiaAbstract
Â
 Objectives: The DREEM inventory has been universally established as a generic instrument to assess health-related educational programs. There were some apprehensions regarding the psychometric properties of the DREEM raised in last few years. This study evaluated first ever the psychometric properties of the Bahasa Melayu version of the DREEM in a sample of Malaysian medical students.
Methods: A cross-sectional study was carried and universal sampling method was applied. Researchers selected 1-5th-year medical students of Universiti Sultan Zainal Abidin, Malaysia, as study subjects. Researchers collected data through a guided self-administered questionnaire during a face-to-face session.
Results: Confirmatory factor analysis (CFA) showed that the one factor model of DREEM-M (Model A), consisting 50 items were not fit, indicating it was a multidimensional instrument. On further CFA, it appeared that the proposed five-factor structure was not fit (Model B) as all the goodness-of-fit indices did not signify a model fit.
Conclusions: The study findings revealed that the DREEM inventory 50-item inventory failed to achieve a model fit, but it demonstrated a high of internal consistency. The proposed 19-item DREEM-M revealed good model fit.
Downloads
References
The Executive Council of the World Federation for Medical Education (WFME): International standards in medical education: assessment and accreditation of medical schools’ - educational programs. A WFME position paper. Med Educ 1998, 32 (5): 549-558.
Chandran CR, Ranjan R. Students’ perceptions of educational climate in a new dental college using the DREEM tool. Adv Med Educ Pract 2015; 6: 83-92. doi:10.2147/AMEP.S74314.
Bakhshialiabad H, Bakhshi M, Hassanshahi G. Students’ perceptions of the academic learning environment in seven medical sciences courses based on DREEM. Adv Med Educ Pract 2015; 6: 195-203. doi:10.2147/AMEP.S60570.
Cunningham J, Wright C, Baird M. Managing Clinical Education Through Understanding Key Principles. Radiol Technol 2015; 86 (3): 257-273.
Hammond SM, O'Rourke M, Kelly M, Bennett D, O' Flynn S. A psychometric appraisal of the DREEM. BMC Med Educ 2012; 12(1): 2. DOI: 10.1186/1472-6920-12-2
Roff S, Mcaleer S, Harden RM, Al-Qahtani M, Ahmed AU, Deza H, Groenen G. Primparyon P. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach 1997; 19 (4): 295-299. Doi.org/10.3109/01421599709034208
Rothman AI, Ayoade F. The development of a learning environment: a questionnaire for use in curriculum evaluation. J Med Educ 1970, 45: 754-759.
Marshall RE. Measuring the medical school learning environment. J Med Educ 1978, 53: 98-104.
Feletti GI, Clarke RM. Review of psychometric features of the medical school learning environment survey. Med Educ 1981, 15: 92-96. DOI: 10.1111/j.1365-2923. 1981. tb02403.x
Moore-west M, Harrington DL, Mennin SP, Kaufman A, Skipper BJ. Distress and attitudes toward the learning environment: effects of a curriculum innovation. Teach Learn Med 1989, 1: 151-157. Doi.org/10.1080/10401338909539400
General Medical council: Tomorrow’s Doctors. Recommendations on Undergraduate Medical Education London, General Medical Council; 1993. Available at http://www.gmc-uk.org/Tomorrow_s_Doctors_1214.pdf_48905759.pdf [Accessed on March 26, 2017]
Chan DSK. Combining qualitative and quantitative methods in assessing hospital learning environments. Int J Nurs Stud 2001, 38: 447-459.
Mulroney A. Development of an instrument to measure the Practice Vocational Training Environment in Ireland. Med Teach. 2005, 27(4): 338-342. Doi.org/10.1371/journal.pone.0137872
Rahman NIA, AA, Zulkifli Z, Haj MA, Nasir FHBM, Pergalathan S, Hamidi MI, Ismail S, Simbak NB, Haque M. Perceptions of students in different phases of medical education of the educational environment: Universiti Sultan Zainal Abidin. Adv Med Educ Pract 2015; 6: 211–222. Doi: 10.2147/AMEP.S78838.
Mohsena M, Debsarma S, Haque M. Determining the Quality of Educational Climate in a Private Medical College in Bangladesh via the ‘Dundee Ready Education Environment Measure’ Instrument. J Young Pharm 2016; 8(3): 266-274. Doi:10.5530/jyp.2016.3.17
Roff S. The Dundee Ready Educational Environment Measure (DREEM)–a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach 2005, 27: 322-325. Doi.org/10.1080/01421590500151054
Said NM, Rogayah J, Hafizah A. A Study of Learning Environments in the Kulliyyah (Faculty) of Nursing, International Islamic University Malaysia. Malay J Med Sci 2009, 16: 11-20.
Thomas BS, Abraham RR, Alexander M, Ramnarayan K. Students’ perceptions regarding educational environment in an Indian dental school. Med Teach 2009, 31: 185-188. Doi: 10.1080/01421590802516749.
Till H. Identifying the perceived weaknesses of a new curriculum by means of the Dundee Ready Education Environment Measure (DREEM) Inventory. Med Teach 2004, 26: 39-45. Doi.org/10.1080/01421590310001642948
Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Med Teach 2010, 32: 947-952. Doi: 10.3109/01421591003686229.
Vaughan B, Mulcahy J, McLaughlin P. The DREEM, part 2: psychometric properties in an osteopathic student population. BMC Med Educ 2014; 14: 100. Doi: 10.1186/1472-6920-14-100
Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: A review. J Educ Res 2006; 99(6): 323-338. Doi.org/10.3200/JOER.99.6.323-338
Said H, Badru BB, Shahid M. Confirmatory Factor Analysis (CFA) for Testing Validity and Reliability Instrument in the Study of Education. Aus J Basic Appli Sci 2011; 5(12): 1098-1103.
Hernandez R. A short form of the subjective well-being scale for Filipinos. EME Rev 2010; 1: 105-115.
Cabrera P. Author Guidelines for Reporting Scale Development and Validation Results in the Journal of the Society for Social Work and Research. J Soc Social Work Res 2010; 1(2): 99-103. Doi: 10.5243/jsswr.2010.8
Jung J, Neumann M, Wirtz M, Ernstmann N, Staratschek-Jox A, Wolf J, Pfaff H. Validation of the SmoCess-GP†instrument - a short patient questionnaire for assessing the smoking cessation activities of general practitioners: a cross-sectional study. BMC Fam Pract 2010; 11:9. DOI: 10.1186/1471-2296-11-9
Atkinson TM, Rosenfeld BD, Sit L, et al. Using Confirmatory Factor Analysis to Evaluate Construct Validity of the Brief Pain Inventory (BPI). J Pain Symptom Manage 2011; 41(3): 558-565. Doi: 10.1016/j.jpainsymman.2010.05.008.
Kalk K, Luik P, Taimalu M, Täht K. Validity and Reliability of Two Instruments to Measure Reflection: A Confirmatory Study. TRAMES 2014; 18(68/63): 2, 121–134.
Hadie SNH, Yusoff MSB. Assessing the validity of the cognitive load scale in a problem-based learning setting. J Taibah Univ Med Sci 2016; 11(3): 194e202. Doi.org/10.1016/j.jtumed.2016.04.001
Majeed AA, Darmawan GN, Lynch P. A Confirmatory Factor Analysis of Attitudes Toward Mathematics Inventory (ATMI). Math Educ 2013; 15 (1): 121-135.
Malaysian Qualifications Agency. Code of Practice for Program Accreditation. 2nd ed. Petaling Jaya, Selangor Darul Ehsan, Malaysia: Malaysian Qualifications Agency; 2008.
Malaysian Qualifications Agency. Code of Practice for Institutional Audit. 1st ed. Petaling Jaya, Selangor Darul Ehsan, Malaysia: Malaysian Qualifications Agency; 2008.
Ismail S, Salam A, Alattraqchi AG, Annamalai L, Chockalingam A, Elena WP, Rahman NIA, Abubakar AR, Haque M. Evaluation of doctors’ performance as facilitators in basic medical science lecture classes in a new Malaysian medical school. Adv Med Edu Pract 2015; 6: 231–237. Doi: 10.2147/AMEP.S78441
Bhagat V, Haque M, Simbak NB, Jaalam K. Study on personality dimension negative emotionality affecting the academic achievement among Malaysian medical students studying in Malaysia and Overseas. Adv Med Edu Pract 2016; 7: 341–346. Doi: 10.2147/AMEP.S108477
Haque M, Rahman NAA, Majumder MAA, Haque SZ, Kamal ZM, Islam MZ, Haque ATME, Rahman NIA, Alattraqchi AG. Internet use and addiction among medical students of Universiti Sultan Zainal Abidin, Malaysia. Psychol Res Behav Manag 2016; 9: 297-307. Doi.org/10.2147/PRBM.S119275
Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract Assess Res Eval 2005; 10(7): 1-9.
McAleer S, Roff S. A practical guide to using the Dundee Ready Education Environment Measure (DREEM). AMEE Medical Education Guide 2001; 23: 29-33.
Roff S, McAleer S. What is educational climate? Med Teach. 2001; 23(4): 333. Doi.org/10.1080/01421590120063312
Khan JS, Tabasum S, Yousafzai UK, Fatima M. DREEM ON: Validation of the Dundee Ready Education Environment Measure in Pakistan. J Pak Med Assoc 2011; 61(9): 885-888.
Dimoliatis I, Vasilaki E, Anastassopoulos P, Ioannidis J, Roff S. Validation of the Greek translation of the Dundee ready education environment measure (DREEM). Educ Health 2010; 23(1): 348.
Jakobsson U, Danielsen N, Edgren G. Psychometric evaluation of the Dundee Ready Educational Environment Measure: Swedish version. Med Teach 2011; 33(5): 267-274. Doi: 10.3109/0142159X.2011.558540.
Riquelme A, Oporto M, Oporto J, Mendez JI, Viviani P, Salech F, Chianale J, Moreno R, Sánchez I. Measuring students' perceptions of the educational climate of the new curriculum at the Pontificia Universidad Catalica de Chile: performance of the Spanish translation of the Dundee Ready Education Environment Measure (DREEM). Educ Health 2009; 22(1):112.
Yusoff MSB. The Dundee Ready Educational Environment Measure: A Confirmatory Factor Analysis in a Sample of Malaysian Medical Students. Int J Hum Soc Sci 2012; 2(16): 313-21.
Yusoff MSB. Stability of DREEM in a Sample of Medical Students: A Prospective Study. Educ Res Int 2012: 1-5. Doi.org/10.1155/2012/509638
Haque M, Zulkifli Z, Nasir FHBM, Majumder MAA, Yusoff MSB, Mustafa A, Hoque R, Islam MZI, Aung MMT. Perception of Tomorrow’s Health-Care Connoisseur and Front-Runners of Their Educational Environment Utilizing DREEM Inventory in Bahasa Melayu version, The Native Language of Malaysia. Aus Med J 2017; 10(5): 396-412.
Yusoff MS, Arifin WN. Educational environment and psychological distress of medical students: The role of a deep learning approach. J Taibah Univ Med Sci 2015; 10(4): 411-418. Doi.org/10.1016/j.jtumed.2015.08.005
Brown TA. Confirmatory factor analysis for applied sciences. New York: The Guilford Press; 2006.
Arbuckle JL. IBM SPSS Amos 19 user's guide. Chicago, US: IBM; 1995. Available from: http://www.amosdevelopment.com/download/amos.pdf [Accessed on March 15, 2017].
Kline RB. Principles and Practice of Structural Equation Modeling. 3rd ed. New York: Guilford Publications; 2010.
Piaw CY. Statistik Penyelidikan Lanjutan. Malaysia: McGraw Hill; 2009.
Browne MW, Cudeck R. Alternative ways of assessing model fit. Soc Method Res. 1992; 21(2): 230-258.
Jöreskog K, Sörbom D. LISREL VI users guide. 3rd ed. Moorsville. In: Scientific Software]is; 1984.
Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990; 107(2): 238.
Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull 1980; 88(3): 588.
Bollen KA. A new incremental fit index for general structural equation models. Soc Method Res 1989; 17(3): 303-316.
Marsh HW, Hocevar D. Application of confirmatory factor analysis to the study of self-concept: First-and higher order factor models and their invariance across groups. Psychol Bull 1985; 97(3): 562.
Nunally JC. Psychometric theory. 2nd ed. New York: McGraw Hill; 1978.
Streiner LD, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. New York: Oxford University Press; 2008.
Yusoff MSB, Rahim AFA, Yaacob M. The Development and Validity of the Medical Student Stressor Questionnaire (MSSQ). ASEAN J Psychiatr 2010; 11(1): 1-12.
Genn JM. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education – a unifying perspective. Med Teach 2001; 23: 337-44. Doi: 10.1080/01421590120063330
Rotem A, Bloomfield L, Southon G. The clinical learning environment. Isr J Med Sci 1996; 32: 705-710.
Mogre V, Amalba A. Psychometric Properties of the Dundee Ready Educational Environment Measure in a Sample of Ghanaian Medical Students. Educ Health 2016; 29: 16-24. Doi: 10.4103/1357-6283.178921.
Yusoff MSB. Psychometric properties of DREEM in a sample of Malaysian medical students. Med Teach 2012; 34 (7): 595-596.
Nunnally JC, Bernstein IH. Psychometric theory. New York, NY: McGraw-Hill, 1994.
Ostapczuk MS, Hugger A, De Bruin J, Ritzâ€Timme S, Rotthoff T. DREEM on, dentists! Students’ perceptions of the educational environment in a German dental school as measured by the Dundee Ready Education Environment Measure. Eur J Den Educ 2012; 16(2): 67-77. Doi: 10.1111/j.1600-0579.2011.00720. x.
Rotthoff T, Ostapczuk MS, De Bruin J, Decking U, Schneider M, Ritz-Timme S. Assessing the learning environment of a faculty: psychometric validation of the German version of the Dundee Ready Education Environment Measure with students and teachers. Med Teach 2011; 33(11): e624-636. Doi: 10.3109/0142159X.2011.610841.
Published
How to Cite
Issue
Section
The publication is licensed under CC By and is open access. Copyright is with author and allowed to retain publishing rights without restrictions.
