Dundee Ready Educational Environment Measure Research

Dundee Ready Educational Environment Measure Research Abstract: Background: DREEM (Dundee Ready Educational Environment Measure) is a validated and global tool for assessing educational environment. It can be used to make comparative analysis of educational environment. Our aim is to study medical school students perception of their environment and correlate this with cGPA, gender and year of study. Materials and Method: This cross-sectional study involved students of semesters 5, 7 and 9 of Dow Medical College from August 2013 to August 2014. DREEM questionnaires were provided to participants in written form. Descriptive statistics were used to evaluate mean and SD score for total DREEM and DREEM domains. ANOVA was used to categorize any variation related to three semesters and unpaired t- test was used to classify gender related variances. Results: Total number of respondents was 246 (response rate=82.0%), of which 69(28.04%) were males and 177(71.95%) were females. Total DREEM score was calculated as 110.4/200(55.2%). Maximum score was established in the domain of students’ self-social perception (56.8%) and lowest in domain of students’ perceptions of learning (53.3%). Conclusion: The research shows that students’ perception of their educational environment is slightly more positive than average. It is clear that cGPA does not have an enormous impact on the mind-set of students as commonly perceived. Key Words: Dundee Ready Education Environment Measure, educational environment, cGPA, undergraduate, medical education. Background: The ‘educational environment’ defined as everything that happens within the classroom, campus or university as whole is crucial in determining the success of undergraduate medical education [1]. In 1998, the World Federation for Medical Education highlighted the learning environment as one of the determining factors in the evaluation of medical education programs 2. Medical educators widely agree upon the fact that the effects of the educational environment, both academic and clinical, are important determinants of medical students’ attitude, knowledge and skill 2. The key to the provision of highly motivated, student centered education is precise evaluation of the academic and clinical aspects of a medical institution. For such highly quality and accurate assessment, there is a need of comprehensive and valid tool [3, 4, 5, 6, 7, 8]. For decades, researchers have assessed and developed various tools to measure learning environment in primary and secondary education as well as for tertiary education [9, 10, 11]. In health profession, nursing educational system and their perceived environment has been studied comprehensively as well [12, 13, 14, 15]. Educators and researchers have attempted to define and measure the medical education environment as basis for implementing modifications and thus optimizing the educational environment [16, 17, 18, 19]. The most widely used contemporary tool is almost certainly the Dundee Ready Education Environment Measure (DREEM) [20]. The DREEM is a 50-item measure of students perceptions of their learning environment which projects scores on five domains. These five domains are labeled as, students’ perception of learning, perception of course organizers, academic self-perception, perception of atmosphere and social self-perception [21]. DREEM questionnaire, developed by an international Delphi panel, has been applied to several undergraduate courses for health professionals worldwide. It produces global readings and diagnostic analyses which allows quality comparisons to be made in the performance and effectiveness of different medical schools. This instrument has been translated into Spanish, Portuguese, Arabic, Chinese, Dutch Swedish, Norwegian, Malay and Thai and used in several settings including the Middle East, Thailand, Nepal and Nigeria [22, 23,24]. It is currently being utilized in the medical schools of the UK, Canada, Ireland, Thailand, Indonesia, Malaysia, Norway, Sweden, Venezuela, the West Indies, Sri Lanka, Oman and the Kingdom Of Saudi Arabia to evaluate the students’ perception and help medical and health schools to recognize their educational priorities and as a result, introduce more effective measures [25, 26, 27, 28, 29 30] Dow Medical College, located in Karachi, is one of the oldest medical schools in Pakistan. In 2003, it became a constituent college of the newly formed Dow University of Health Sciences. Gradual but definitive changes in the teaching strategies are being implemented at Dow Medical College. With the batch of 2009, Dow University of Health Sciences has introduced an integrated modular curriculum. Dow University is the first public sector medical university of Pakistan to have introduced this modern method of education. The curriculum has been developed by a strong team of faculty members of the University and this has greatly enhanced the teaching standards. Moreover, it has proved to greatly impact students’ perception of their learning environment. The course work of five years has been divided into 10 semesters and a semester examination is conducted at the end of the course of 6 months. Modular and midterm examinations are held for regular appraisal of students. The rationale of this study is to evaluate the effect of cGPA on the students’ perception of educational environment at Dow Medical College, and to assess any differences in perception related to gender and year of study using Dundee Ready Education Environment Measure (DREEM). Materials and Methods: This is a cross-sectional study, conducted on the target population of the students of semester 5, 7 9 of Dow Medical College, Karachi from 30th August 2013 to 30th August 2014. The study was approved by the Medical Ethics Committee of Dow University of Health Sciences. DREEM questionnaires were distributed to 246 students of semesters 5, 7 9. DREEM consists of 50 statements, grouped in five domains, relevant to the educational environment. The respondents were asked to read each statement carefully and to respond using a five-point Likert scales ranging from strongly agree to strongly disagree. Each item was scored as follows: 4 for strongly agree, 3 for agree, 2 for uncertain, 1 for disagree and 0 for strongly disagree. The DREEM inventory has a maximum score of 200. It consists of the following domains: Students Perceptions of Learning (12 questions, maximum score: 48) Students Perceptions of Teachers (11 questions, maximum score: 44) Students Academic Self-Perceptions (8 questions, maximum score: 32) Students Perceptions of Atmosphere (12 questions, maximum score: 48) Students Social Self-Perceptions (7 questions, maximum score: 28) It was made sure that the personal identity of the students remained anonymous. It was also explained that the data would not be forwarded to third party. Before distributing the research questionnaire to the students, a thorough explanation was given to them in order to describe the objectives dimensions of the study. Data was analyzed using SPSS version-16.0. Descriptive statistics tool was used to evaluate arithmetic means and standard deviation for total DREEM all five sub-scales. ANOVA was used to categorize any variation related to three semesters and level of significance was taken at â€Å"p Results: Response rate: Response rate was 82% (246/300), distribution of response rate of students in selected semesters in chosen medical school was semester 5: 101 (41.05%); semester 7: 75 (30.48%); semester 9: 70 (28.45%). Male and female students accounted for 69 (28.04%) and 177 (71.95%) for responding samples, respectively. Total DREEM mean score was calculated to be 110.4/200 (55.2%) among all three semesters. Components of Table 1, are: Maximum and minimum scores of DREEM inventory and its five domains, arithmetic mean with standard deviation and percentage of mean score with interpretations. In Table 1, the highest score was recorded in the domain of students’ social self-perceptions (56.8%) and lowest in the of students’ perception of learning domain (53.3%). Table 2 shows the mean scores of DREEM inventory in selected semesters. There has been a significant difference in the perceptions of students of 5th, 7th and 9th semesters regarding environment. Students of 9th semester hold a considerable positive attitude which is exhibited not only by their mean DREEM score but also when viewing all the domains of DREEM individually, with a maximum of 61.4% positivity in the domain of â€Å"Students’ self-social perception† and a minimum of 58.8% in the sub-scale of â€Å"Students’ perception of atmosphere†. Response of 7th semester students’ is somewhat positive as shown by their mean DREEM score of 112/200 (56%), score being highest of 57.8% in the subscale of â€Å"Students’ social self-perceptions† and lowest of 54.3% in â€Å"Students’ perception of teachers† domain. Response of 5th semester students’ in all domains, though not in negative integers, is certainly poor being just 51.35% on the mean DREEM score of 102.7/200. Response rate is maximum in the sub-scale of â€Å"Students’ social self-perceptions† and minimum in â€Å"Students’ perception of learning† These results show that students of all three semesters had maximum positive response as represented by their respective scores in the sub-scale of â€Å"Students’ social self-perception†. This is further explained under the section of discussions. Table 3 describes another objective of this study which is, the effect of cGPA on students’ mind-set regarding academic studies, social life and professors. Using DREEM inventory, it is remarkable to know that cGPA is an insignificant factor from analyzed data. This is suggestive that cGPA is not an accurate representative of academic status of student at the medical college. Table 4 delineates difference in the observation of educational environment among male and female gender. Males were found to be more positive about educational environment with response rate of 58.1% on total DREEM score of 116.2/200 while females had the total DREEM score of 108.1/200 with response rate of 54.1%. Males’ response was substantially more positive in every subscale except â€Å"Students’ academic self-perceptions† domain which was determined as a non-significant factor in this comparison between males and females. Discussion: According to the practical guide of McAleer, a mean score between 50 and 100 indicates probable problems in the learning environment [31]. In medical schools with a traditional curriculum, domain scores are found to be below 120; however, in modern, student-centered curriculums, the mean score is generally improved [32]. The results presented herein revealed a mean score of 110.4/200 (55.2%) for the DREEM five domains. Subscale analysis exhibited maximum in the section of students’ social self-perceptions and lowest in domain of students’ perception of learning. The DREEM score of students of 9th semester was slightly positive than students of 5th and 7th semesters presumably because they did not follow the modular system. Their studies were not fast paced and so they were not over burdened by the course. Since the modular system has specified a limited time span for the completion of each course comprehensively, the high burn out rate was apparent in students of this new, fast paced system. Hence the students of 5th and 7th semesters perceived the milieu more negatively than semester 9 students. Effect of cGPA on students’ academic lives was an important aspect of this study. From the results obtained, it is clear that cGPA did not have an enormous impact on the mind-set of students as commonly anticipated. This could be attributable to a fact that majority of the students at DMC, instead of competing for marks, aimed to compete for practical expertise. From the response given by the students, it also appeared that respondents of this research preferred their semester papers to be more clinically oriented in lieu of constructed on outmoded system which is based rote-learning. Students’ perception of the educational environment has a considerable influence on their performance, motivation and academic accomplishments. The analysis also showed the lowest score in the domain of students’ perception of self-learning. It could be attributable to compact learning time and challenging course. This is a point of concern because students are important stake holders of any educational institution and if they are not satisfied with the perception of self-learning then this matter should be taken into consideration by the concerned authorities with sincerity and wherever necessary, credence should be given to students opinion as well. The analysis explains the DREEM score of male students to be more positive than the female students. One reason of this might be the ratio of female students is much higher than the ratio of male students in medical colleges which may be the cause of a competitive approach to learning amongst girls hence more chances of disappointments and negative opinions about the environment. Conclusion: It is concluded that cGPA does not have an enormous impact on the mind-set of students. In all sub-scales, the DREEM score is slightly more positive than average. Mean DREEM score in all three semesters in Dow Medical College is 110.4/200 (55.2%). Sub-scale analysis revealed maximum score in the domain of students’ social self-perceptions and lowest in domain of students’ perception of learning. Hence, results obtained in study can be astutely used to make reforms in academic curriculum, examination patterns, and to direct tactical improvement in order to make educational environment more interesting and better for students. Competing interests: Authors contributions: Authors information: Acknowledgements: References: [1]. Lokuhetty M, Warnakulasuriya S, Perera R, De Silva H, Wijesinghe H. Students’ perception of the educational environment in a Medical Faculty with an innovative curriculum in Sri Lanka. South-East Asian Journal of Medical Education. 2011;4(1):916. [2]. Hammond S, ORourke M, Kelly M, Bennett D, OFlynn S. A psychometric appraisal of the DREEM. BMC medical education. 2012;12(1):2. [3]. Maida A, Vasquez A, Herskovic V, Calderon J, Jacard M, Pereira A et al. A report on student abuse during medical training. Medical teacher. 2003;25(5):497501. [4]. Snadden D. Editorial: Student health and abuse: what is going on out there? Medical teacher. 2003;25(5):461462. [5]. Kovatz S, Notzer N, Bleiberg I, Shenkman L. Cultural perception of harassment in two groups of medical students: American and Israeli. Medical Teacher. 2004;26(4):349352. [6]. Seabrook M. Clinical students initial reports of the educational climate in a single medical school. Medical education. 2004;38(6):659669. [7]. Seabrook M. Intimidation in medical education: students and teachers perspectives. Studies in Higher Education. 2004;29(1):5974. [8]. Lempp H, Seale C. The hidden curriculum in undergraduate medical education: qualitative study of medical students perceptions of teaching. BMJ. 2004;329(7469):770-3. [9]. Fraser, B. (1982). Development of short forms of several classroom environment scales. Journal of Educational Measurement, 19(3), pp.221227. [10]. Trickett EJ, Moos RH, Press CP. Classroom environment scale: Consulting Psychologists Press; 1987. [11]. Pace CR, Stern GG. An approach to the measurement of psychological characteristics of college environments. Journal of Educational Psychology. 1958;49(5):269. [12]. Chan D. Development of an innovative tool to assess hospital learning environments. Nurse Education Today. 2001;21(8):624-31. [13]. Chan DS. Combining qualitative and quantitative methods in assessing hospital learning environments. International journal of nursing studies. 2001;38(4):447-59. [14]. Chan D. Development of the Clinical Learning Environment Inventory: using the theoretical framework of learning environment studies to assess nursing students perceptions of the hospital as a learning environment. The Journal of nursing education. 2002;41(2):69-75. [15]. Saarikoski M, Leino-Kilpi H. The clinical learning environment and supervision by staff nurses: developing the instrument. International Journal of Nursing Studies. 2002;39(3):259-67. [16]. Rothman A, Ayoade F. The development of a learning environment: a questionnaire for use in curriculum evaluation. Academic Medicine. 1970;45(10):7549. [17]. 5.Marshall R. Measuring the medical school learning environment. Academic Medicine. 1978;53(2):98104. [18]. Feletti G, Clarke R. Review of psychometric features of the medical school learning environment survey. Medical Education. 1981;15(2):9296. [19]. Moore-West M, Harrington D, Mennin S, Kaufman A, Skipper B. Distress and attitudes toward the learning environment: effects of a curriculum innovation. Teaching and Learning in Medicine: An International Journal. 1989;1(3):151157. [20].Roff S, McAleer S, Harden R, Al-Qahtani M, Ahmed A, Deza H et al. Development and validation of the Dundee ready education environment measure (DREEM). Medical Teacher. 1997;19(4):295—299. [21]. Roff S. The Dundee Ready Educational Environment Measure (DREEM)-a generic instrument for measuring students perceptions of undergraduate health professions curricula. Medical Teacher. 2005;27(4):322-5. [22]. Al-Qahtani MFM. Approaches to study and learning environment in medical schools with special reference to the Gulf countries: University of Dundee; 1999. [23]. Pimparyon SMC, S. Pemba, S. Roff, P. Educational environment, student approaches to learning and academic achievement in a Thai nursing school. Medical Teacher. 2000;22(4):359-64. [24]. Roff S, McAleer S, Ifere O, Bhattacharya S. A global diagnostic tool for measuring educational environment: comparing Nigeria and Nepal. Medical teacher. 2001;23(4):378-82. [25]. Till H, Roff S, McAleer S, editors. Identifying the Strengths and Weaknesses of a New Curriculum by Means of the DREEM Inventory. Poster presentation at AMEE Conference, Lisbon; 2002. [26]. Till H. Identifying the perceived weaknesses of a new curriculum by means of the Dundee Ready Education Environment Measure (DREEM) Inventory. Medical teacher. 2004;26(1):39-45. [27]. Zamzuri A, Ali A, Roff S, McAleer S. Students perceptions of the educational environment at dental training college. Malaysian Dent J. 2004;25:15-26. [28]. Bassaw B, Roff S, McAleer S, Roopnarinesingh S, De Lisle J, Teelucksingh S, et al. Students perspectives on the educational environment, Faculty of Medical Sciences, Trinidad. Medical teacher. 2003;25(5):522-6. [29]. Al-Zidgali L. Students’ approaches to studying at the Institute of Health Sciences, Sultanate of Oman. Masters of Medical Education dissertation, University of Dundee. 1999. [30]. Al-hazimi A, Al-hyiani A, Roff S. Perceptions of the educational environment of the medical school in King Abdul Aziz University, Saudi Arabia. Medical teacher. 2004;26(6):570-3. [31]. McAleer S, Roff S: A practical guide to using the Dundee Ready Education Environment Measure (DREEM). Curriculum, Environment, Climate, Quality and Change in Medical Education: a Unifying Perspective. AMEE Education Guide No. 23. Dundee: Association for Medical Education in Europe Edited by Genn JM. 2001, 29-33. [32]. http://www.biomedcentral.com/1472-6920/10/87