A classroom observation is the purposeful examination of teaching and/or learning events through the systematic processes of data collection and analysis (Bailey, 2001). Classroom observation was also defined as a process by which the observer sits in on one or more classroom sessions, records the instructor’s teaching practices and student actions, and then meets with the instructor to discuss the observations. Therefore, it is a collaborative process. Both the teacher being observed and the observer having significant roles before, during, and after the observation process. Collaborating at each phase of the process can help place both participants at ease so that each benefits from the experience. The main purpose behind the classroom observation is to allow a teacher to get feedback from an objective, experienced observer and to involve in context-specific discussions about teaching with an adviser. Moreover, data will be collected on what the teacher is doing what they should probably be doing; classroom learning environment will be assessed and reported to the stakeholders. Additionally, the teacher’s capability to demonstrate various teaching methods is also observed (Wragg, 1999).
The observation should not be an endorsement for promotion and tenure, a judgment of the teacher’s teaching methods, styles and skills, or an assessment of the teacher’s knowledge of disciplinary content. It is purely developmental rather than intimidation and making decisions.
Classroom observation has been used for long time to evaluate the quality of teaching provided and the consistency between the curriculum plan and the actual delivery of the material by teachers. Wragg (1999) stated that “ the purpose of looking at implementation is to see whether there is a mismatch between intention and strategies”. Classroom observation has constantly been seen as an effortful task from the side of the teachers. Negative attitudes have been expressed from several teachers venting their disappointment about the process by which observation has been implemented. This feeling of unhappiness and dissatisfaction is not a product of today; it is possibly an aggregation of many years of authoritarian, impressionistic, and impartial models of supervisions with teachers feeling of little ownership. Because the observer has a great role in renewing the teacher’s contracts, they had to conform to the supervisor’s viewpoints. This is considered an exceptional limitation of the observation process.
At the level of Fujairah- Institute of Nursing (ION), instructors have expressed the issue of inconsistency in the perception of the observation tool among the observers many times. In addition to the way, the classroom observation is conducted. Therefore, these issues needed to be investigated at the IONION . This paper aims to find out any discrepancies in the understanding of the observation tool used by the observers, and to identify the teacher perceptions of the classroom observation method. The results of the study will be reported to the curriculum committee and teachers as well.
To pursue the task appropriately, a two phase qualitative study was conducted. In the first phase, the observation instrument revisited to see whether the observers perceive its item similarly or not. In the second phase, a questionnaire was distributed to all ION teachers in an attempt to evaluate the method of observation conducted there.
Therefore, this paper is an attempt to answer the following questions:
Is there a significant difference in the perception of the same observation items within the instrument used by the different advisors” in the ION?
Is there any defect in the observation process?
Literature Review:
Classroom observation is certainly the most common form of collecting data for teacher appraisal. So as to attain a representative sample of the tutor’s performance in the class, a number of different classroom observations need to be implemented. One classroom observation does not impart adequate data. A common criticism by tutors is that observers do not take the needed time to collect pertinent data and provide them with valuable feedback. Conversely, teacher inspectors want particular vehicle not only for performance data collection but also for communicating it to the instructor.
Over the past several years, diverse research indicated that the way teachers behave in the classroom and the instructional approaches they use influence the degree students learn. Using classroom observations, educators and researchers are able to provide feedback that may lead to changes in teaching practices. Hopkins (2002) believes that the motivation behind any school observation does not stop at classroom research but it also extends to the professional development of teachers. It is because of the many years of observations that modern educationalists decided to abandon through time the conventional ‘ recitation lesson’, that is the formal presentation of information by the teacher standing at the front of the class, was standard (Wragg, 1999).
Clearly, different forms of observations encompass various criteria. These criteria may be comprehensive or specific. Some observation forms may focus on the students’ behavior while others may seek out the response of teachers to such behaviors. According to Hopkins (2002), there are four methods of observation: open, focused, structured, and systematic. Each method needs special instrument. . Observation tools are forms that are to be filled out by the observer. Depending on the observation technique, some forms or instruments may simply be a blank sheet, a worksheet, a scale, checklists, computer software, or a tally sheet. Some observers may be affected by the setting in which the lesson takes place and may focus on some particular feature of the teaching of one specific subject, like science or English. This in turn may influence whether they adopt a quantitative style, which is a type of systematic approach; counting and recording of individual events, or a qualitative method, which is a type of the open observation approach, trying to look behind and beneath the mere frequencies (wragg 1999).
Furthermore, there are many observations tools used by teachers on their classes or in peer observation settings (Malamah-Thomas 1987, Wajnryb 1992). Such instruments are powerful developmental tools for teachers and for trainee advisors, allowing both to look at the lesson systematically in conjunction with the feedback from advisors. Therefore, teachers and observers must perceive the instruments similarly to avoid misinterpretations and predispositions of the items within the tools.
In addition, the classroom observation is seen as a crucial element of each educational system, researchers have found that teachers were not satisfied with the observation process. The main reasons researchers found were judgmental, evaluative nature of observation, authoritative role of observers and prescriptive nature of feedback (Akbari and Tajik 2007).
Wang and Seth (1998) found out that classroom observation has gained a negative reputation in the ELT profession because of its subjective, judgmental, and ill-defined nature. Many instructors resent being observed at short notice by ‘ important people’ who judge their performance according to their own, not necessarily appropriate criteria, and make unwelcome ‘ suggestions’ for change. It seems as if these inspectors have the final word on whether their performance is good or bad, right or wrong.
In many situations, the observers enter the classes to look at the teachers’ performances to decide at the end of the academic year who will continue in his/her job or not. Certainly, this perception places teachers under too much stress, which negatively impacts their performance in the classroom. Randall and Thornton (2001) believed that anxiety levels in the lesson execution phase can become very high and can precipitate failure on the side of the teacher to generate an effective lesson (Fig 2).
Figure 2: The effect of anxiety on performance (adapted from Randall and Thornton, 2001)
Bennet, (1992, cited in Howard, A 2011) stated that classroom observation for some instructors will certainly be a substantial threat. This is true, if…. the purpose of the observation is perceived by the instructor as a mean to judge their quality of teaching and offer suggestions for future enhancement, this will make the experienced teachers much more anxious than a novel capable teacher who has less experience with regular guests to the classroom. This suggest that the observer must play as essential role in relieving teacher’s anxiety and fear by identifying the developmental role of the observation.
Regarding the process of the classroom observation in the UAE, Alwan (2001) finds out that the instructors in the UAE are acquainted with the observation; however, it does not take the systematic approach that would increase the achievements for the teachers.
Consequently, such ad-hoc appraisal practices can simply yield extensive teacher anxiety, a lack of belief in the validity of the observation, and a delicate discouragement of other institutional initiatives to sustenance teachers’ efforts to deliver courses effectively (Murdoch, 2000).
Nevertheless, classroom observation should be intended at enhancing professional growth of the teacher rather than threatening them. It should also focus on the strengths of the lesson. The tutors and through their dealings with the students will recall which areas delivered in a good manner and the ones that require revisiting. It is valuable to point out that the advisors’ role is to explore with the teachers so that they have the chance to reflect on their own teaching with the expectation that this approach will turn into a fundamental part of the teaching and learning process. Therefore, it changes into a reflection in action process that is conducted during the teaching learning process. Schon (1983) explained this reflective process by saying:
“ Both ordinary people and professional practitioners often think about what they are doing, sometimes even while doing it. Stimulated by surprise, they turn thought back on action and on the knowing which is implicit in action…usually reflection on knowing-in-action goes together with reflection on the stuff at hand. (Schon, 1 989)”
Therefore, classroom observation is getting more importance than before. The purpose of many of them is intended towards professional development. It is through experiential learning that the tutors will be self-evaluative and hence will be capable of reflecting on their teaching strategy. Heron (cited in Randall and Thornton 2001) said that working from experience the client (the teacher) is prompted to ‘ uncover’ incidents, which are important, ‘ reflect’ on these incidents and to discover new meanings for these incidents, and then ‘ prepare’ to put the learning from experience and reflection back into a new experience.
Finally, it is of merit to mention that teachers teach many lessons of which only few of them are observed. Accordingly, if the observed lessons are considered valuable and eligible to be observed then they must be regarded as worthy to be analyzed appropriately, for little purpose was served if, after a lesson, observers simply exude good will, mumble vaguely or appear to be uncertain why they are there, or what they should talk about (Wragg, 1999). There is now a vast constituency of individuals who need to be sentient of what is included in classroom observation or how it might be directed. These involve teachers, heads, student teachers, inspectors, appraisers, researchers, and curriculum. Masterfully held classroom observation can help both the observer and the teacher being observed, tending to update and improve the professional dexterity of both persons. Badly handled, however, it becomes counter- productive, at its worst arousing anger, opposition and distrust.
Methodology:
Observation Method
Classroom observation is conducted through three phases that were adapted from Day (1993) and Richards and Lockhart (1994) were: pre-observation meeting, observation phase, and post-observation follow-up phase. The researcher will be using the ION designated tool during the observation process. (Fig 1).
Pre-conference phase is executed before the classroom observation. The purpose of this meeting to share information that helps both the instructor and observer prepare for the observation and to illuminate the explicit outcomes of the lesson observed. It also aims at clarifying the activities through which these outcomes will be attained. Information exchanged during this meeting includes the overall process of the evaluation, the purpose of the observation, course information, lesson plan, instructional objective(s) , class activities, instructional methods, What
you
want the
observer
to
pay
attention
to, Where
you’d
like
the
observer to
sit, what will happen during the observation, and observation follow up opportunities. This phase does not take place in the ION.
The second stage of the process is the observation phase (Data Collection) or the execution of lesson. The ION observers gather information to be discussed latter with the tutor. These data include instructor
doing/saying, students
doing/saying, instructional methods, teacher-students interaction, and flow of the session…etc. Generally, the ASP will use a checklist tool designed for this purpose of classroom observation (Appendix 2). The observers, unlike the traditional supervisors who usually sit at the back and document the classroom events, sit where they can have a good view of the class.
Analysis of the collected data and preparing for the post-conference take place immediately, next to the observation, it is suggested that observers code the data checked in their notes. Identify information that links to the following: Organization and presentation of the lesson, level of student concentration, interactions, and participation, the quality of interpersonal relationships between the teacher and students, effectiveness of instruction and how instruction could be improved.
The third stage is the post-conference phase or follow-up. Shortly after the observation, the advisors emphasize the positive areas of the observation process such as the strengths of the lesson. The teacher will be asked to evaluate and reflect on his lesson at first. Then, the observers will discuss the collected data with the teacher. It is a descriptive stage where the observers describe the various phases of the lesson. The observers during this phase ask probing questions that guide the teacher through the process. They also provide direct feedback on the areas the teacher has asked for in the pre-observation conference. In doing so, many of the areas for improvement are originally stated by the teachers because they had a chance to reflect on their teaching. In the ION context, the post conference session is short. The teacher is not given the needed time to reflect on his session. In many occasions, the teacher and the observer do agree with each other.
Figure Observation Cycle: Adapted from: http://www. commnet. edu/emprel/trng/tm_3_2_clasobs. html (2004).
Setting:
The United Arab Emirates (UAE) encompass three institutes of Nursing (ION) located in Sharjah, Ras ELkhaimeh and Fujairah Emirates, and they are governed by the Ministry of Health (MOH). According to the policy, the ION has an observation system performed by three persons: the Central Academics Coordinator (CAC), Academic Support Person (ASP) and the Branch Manager (BM). The classroom observation is held two times per semester and as needed. One observation is announced and the other is unannounced. At the level of each ION; the observation responsibility is delegated to the ASP. In case the teacher observation result was not satisfactory, the CAC will be called to reobserve the same teacher within two weeks of the unsatisfactory observation but can also observe those with satisfactory outcomes. The BM does a spot check from time to time on the ongoing of the teaching process. The three observers use the same observation instrument, which is qualitative (open methods) in nature where observation bias can sometimes significantly affect the result.
The session Appraisal form is composed of 29 items focusing on two areas of classroom practices: Effective Questioning (eight items), Effective Teaching Practices (21 items). These items are marked as, Accomplished, Partially accomplished, and Not accomplished. The result is either satisfactory or unsatisfactory (Appendix 2).
The adopted teaching methodologies are cased-based and lecture-based, depending on the course. Most of the teachers at the ION are well experienced and hold master degree. I have been working as a senior nursing tutor for the last seven years in the ION. It happened more than once a teacher got two or more different feedbacks from the observers. The teachers always blame the observers for their inconsistency in the understanding of the observation items and in the way the observation is conducted. The majority of the tutors wonder whether a difference should be there while using the same observation checklist and similar observation methods. The investigator will try to answer this question and orient the teachers to the findings.
To inquire about teacher’s dissatisfaction with the overall observation process, a two phase qualitative study was conducted. In the first phase, the observation instrument revisited to see whether the observers perceive its item similarly or not. In the second phase, a questionnaire was distributed to all ION teachers in an attempt to evaluate the method of observation conducted there.
To pursue the task appropriately, the advisors will not be participated in any other job but collecting data. Randall and Thornton (2005) refer to an advisor that has no other than to observe and take notes as a non-participant observer (Gebhard and Oprandy 1999). As the name designates, this kind of observation requires the observer not to engage in any interaction with the individuals being observed. Instead, the observer should concentrate on a particular behavior – a specific criterion (Wragg, 1999, Hopkins 1999, 2002). For an observer, it is very important to avoid preconceptions and afterward approach whatever is to be observed with an open mind (Wragg 1999).
Validity and reliability in observation
It is essential that observation is as objective as expected and advisors must be mindful of their own interests and predispositions so that the data gained is as valid and reliable as conceivable and not designated to verify a point (CCC 2004).
– Observers customarily continue-the-spot notes to complete an observation schedule so that any extra or uncommon actions can be noted. For example ‘ A come into the class and talked to teacher. This interrupted classroom for 3 minutes; ‘ Fire alarm rang at 2. 24pm so the class was shorter today than usual’.
-’Field notes’ are often written post assessment and the advice is to do this as early as possible. Robson (2002) proposes that you should ‘ never begin a second class observation before sorting out your records for the first one’
– Practice in utilizing a schedule before the ‘ actual’ observation will assist the observer to settle uncertainties in how to employ it or how to record unforeseen or vague data.
– Reliability of observation will originate from appraiser consistency. Appraisers have to make sure that they make parallel decisions about similar situations on diverse events. They must also take similar decisions about similar events if they see or hear them again; say on video or audio tape.
– Preferably, having more than one appraiser observing the same events, at least in initial practice sessions, so that there can be agreement on what is going on and how it is to be coded.
The two observers at the ION were aware of these points to ensure the validity and reliability of the class supervision.
Ethical Considerations
The ethical considerations were carefully considered before conducting the study. A permission letter was sent to the concerned people to consent them. Anonymity and confidentiality of teachers’ responses guaranteed (Appendix 3).
Part I:
Procedures and Participants
Two observers visited Diploma I class to assess a teacher teaching Nursing Care of Adults 201. One of the observers is the ASP whose tenure is 11 years and the other is a critical friend who holds a master degree in education and has 10 years of teaching experience (table1). Both are familiar with the observation tool. This approach was used to explore inconsistencies in the perception of the observation items within the specified from. They were informed about the process; they should sit at different corners in the back of the class (Fig 5), do not speak to each other, and fill in the appraisal form the way they perceive it with an evidence for each partially or not accomplished item.
Data Analysis
At the end of the classroom observation the researcher collected the two filled forms and sit with the two observers to discuss the findings. The observers’ findings and teachers’ responses were organized for analysis and interpretation through the use of simple statistic. Tables and graphs were employed to summarize data and to present the findings of the investigation.
Results
The two forms were collected, and it was found that two items were uneven where each tutor has his own perception.
Class
Subject
Observer 1
Observer 2
Session Time
Teaching Method
Diploma 1
Nursing Care of Adults/Hyperthyroidism
Academic support person, 11 year teachings Experience
Critical Friend, more than 10 years teaching
50 minutes
Case-based
Table 1: Observation setting
The mismatched items were two out of 29 items; the two items were located under the Effective Teaching practices Table 2). Finding of the first observer marked as (1) and (2) for the second.
Effective Teaching practices
Accomplished
Partially Accomplished
Not Accomplished
26. Asks students to evaluate their own or other responses.
2
1
29. Demonstrate the ability of dealing with problem students
1
2
Table 2: Observer’s findings
Observers Justification
First observer
26. Asking student to evaluate and reflect on the answers given, getting feedback from classmates should be done frequently in the case based session as this would involve the students in the class and enhance their understanding. This should be observed as a dominant feature in the session and not only once or two.
29. The students were enthusiastic, motivated and participating actively. It was loud voice but not noise, but you have to ask students to lower their voices to hear their classmates “. Raising their hands without calling ‘ Sir’…. Is fair enough.
Second observer
26. Students were fairly able evaluate their answers, and that was done with two students only. As for the responses of their colleagues; the students were called more than once to reflect on their answers when the teacher asked them: 1) Do you agree with S? Why? 2) Why did M relate the presence of excessive eating to weight loss? Comment on her answer. Although, the teacher tried with them, the students were not able to evaluate their responses.
29. Loud voice from the side of the students will disturb the learning environment preventing the others from hearing the answers. The teacher tried to control students’ noise, particularly when they gave an answer together, but he could not. Abiding by the classroom norms is the responsibility of the teacher. Setting clear guidelines should be made to limit this behavior.
At the back of the session appraisal form there is a room left for the appraiser’s comment to reflect and set the areas that need improvement on points that are not covered clearly in the observation form but should be part of the lesson, or he may emphasize certain points seen in the class.
The first observer
A) Group work:
The teacher should give more time (more than 10 minutes) for the group work to allow the students to prepare and discuss the task properly among them as the task given require deep analysis. Moreover, the teacher should ensure that all the students are participating in the discussion within the group.
Checking group work output is not necessary to be done with each group, as far one or two groups were investigated, then the other groups could be done if required by the judgment of the tutor”.
The Second observer
A) Group work:
Ten minutes for each task is fair enough as the students should come prepared from their home. The time is given only for discussion and preparing the transparency. Giving more time will waste the teacher time and hinder his ability to cover the course objectives.
Group work output was not explored: teacher has to reveal all group findings and seek evaluation or comments from other groups.
The first observer
B) Teaching strategy
The teacher should implement various teaching strategies in the classroom such as role play, watching and commenting on videos to promote students’ understanding, involvement and make the session interesting.
The Second observer
B) Teaching strategy
The session was quite interesting. According to the task discussed in the session, role play or video would not be effective as the demonstrations used by the teacher plus the clinical examples and the real life examples given by some students were satisfactory to cultivate the different concepts in the sessions.
Discussion
One method for analyzing the observation findings of the two observers is through triangulation.” Triangulation in the classroom research involves checking the perceptions of more than one person to see if one’s own interpretations have any support “ Wragg (1999). The total number of the items in the observation checklist is 29, and the debatable points were 2. Then, the agreement was around 93% and disagreement in 7%, which means that the instrument used is reliable. “ When the observers agree on > 80% of their observation, this means the information and the data are reliable” Wragg (1999).
It is believed that different style dimensions of learning of the observer may have a possible influence on providing feedback to the teacher. (Randall and Thornton 2001). The first observer, the academic support person, conducted more than four observations to the observed teacher, and knows him better than the second colleague. Hence, he built his feedback on his previous knowledge of the learning style of the observed teacher and provided the feedback in a consultative rather than confronting approach, “ The students were enthusiastic and participating actively. It was loud voice, but not noise, but you have to remind students to lower their voice to hear their colleagues “.
Part II
Procedure:
The participants filled a qualitative questionnaire of seven questions (Appendix I). The questionnaire was piloted before being administered. A total of eleven questionnaires were administered through face to face contact with the investigator. Ten of them were collected and analyzed.
Participants
The participants in this study were ten teachers of Nursing in one of IONs. They have been teaching in the ION for more than seven years. Those teachers have been observed by three different observers using the same tool. The teachers are male and females and range in age from 36 to late 54. They majority of them are native Arabic speakers from different countries, and two teachers are westerns. They are of multi-cultural background.
Data Analysis
The responses to the questionnaire were gathered and then analyzed (table 3). The responses were calculated using simple statistics and presented in charts.
Items
No. of Teachers
Percentage
I have been observed two times by the ASP.
8
80%
I have been observed three times, two by the ASP and once by the CAC.
2
20%
I felt anxious and blocked when the observer visited my class.
10
100%
I am dissatisfied with the way I observed. I did not meet with the observer before the session.
10
100%
The way the observer enters and sits anywhere in the class, ticking on the observation form.
7
70%
The observer did not identify himself to the students, creating unstable setting in the class.
7
70%
The late feedback does not reflect the immediate feedback.
8
80 %
The observation is not intended at teacher development.
9
90%
The feedback is threatening if it is unsatisfactory.
9
90%
Classroom observation does not fulfill my educational need.
7
70
Classroom observation has no impact, whether negative or positive.
2
20%
Classroom observation partially fulfills my educational need.
1
10%
Table 3: Results of the Questionnaire
Discussion and recommendations
The present part of this study addressed the question of the teachers’ perception of the classroom observation method. Based on the analysis of the first phase of the study; it seems that there is no problem in the observation tool. So, where is the problem? The result of the questionnaire provided to ten teachers revealed that the problem is in the observation process itself. The majority of the tutors (80%) have been observed two times per semester by the ASP (four times/year) whereas the remaining 20 % were observed three times by the ASP and the CAC (table 4). This is considered inconsistent when compared to the other educational institutes where the teacher is observed one or two times per year. This will also put more stress on the teachers. All the teachers (100%) expressed various levels of frustration and anxiety when they are observed. They assured that the observers themselves were a source of apprehension. Teachers added that none of the observers take an action to alleviate their anxiety. These findings were similar to that of Randall and Thornton (2001) who stated that anxiety levels in the lesson phase can become very high and can lead to failure on the part of the teacher to produce an effective lesson. Moreover, Akbari, R., et al (2007), found that teacher observation causes stress in both teachers and learners. All the tutors (100%) expressed their feelings of dissatisfaction with the observation methods as no pre observation conference is conducted neither before the announced nor the unannounced visits. This puts more pressure on the side of the observees. A brief talk with the teacher prior to the session will help in alleviating teachers’ anxiety (Randall and Thornton 2001) and a kind of respect to the teachers’ rights that encourages reflective teaching (Akbari, R., et al 2007). Furthermore, 70% of the teachers considered the way the observer enters and sits anywhere in the class, ticking
