Reliability Issues and Solutions for Coding Social Communication Performance in Classroom Settings

Olswang, Lesley B.; Svensson, Liselotte; Coggins, Truman E.; Beilinson, Jill S.; Donaldson, Amy L.
October 2006
Journal of Speech, Language & Hearing Research;Oct2006, Vol. 49 Issue 5, p1058
Academic Journal
Purpose: To explore the utility of time-interval analysis for documenting the reliability of coding social communication performance of children in classroom settings. Of particular interest was finding a method for determining whether independent observers could reliably judge both occurrence and duration of ongoing behavioral dimensions for describing social communication performance. Method: Four coders participated in this study. They observed and independently coded 6 social communication behavioral dimensions using handheld computers. The dimensions were mutually exclusive and accounted for all verbal and nonverbal productions during a specified time frame. The technology allowed for coding frequency and duration for each entered code. Data were collected from 20 different 2-min video segments of children in kindergarten through 3rd-grade classrooms. Data were analyzed for interobserver and intraobserver agreements using time-interval sorting and Cohen's kappa. Further, interval size and total observation length were manipulated to determine their influence on reliability. Results: The data revealed interval sorting and kappa to be a suitable method for examining reliability of occurrence and duration of ongoing social communication behavioral dimensions. Nearly all comparisons yielded medium to large kappa values; interval size and length of observation minimally affected results. Implications: The analysis procedure described in this research solves a challenge in reliability: comparing coding by independent observers of both occurrence and duration of behaviors. Results indicate the utility of a new coding taxonomy and technology for application in online observations of social communication in a classroom setting.


Related Articles

  • APPREHENSIVES' PERCEPTION OF CLASSROOM FACTORS INFLUENCING THEIR CLASS PARTICIPATION. Neer, Michael R.; Kircher, W. Faye // Communication Research Reports;Jun1989, Vol. 6 Issue 1, p70 

    The study investigated factors that classroom apprehensives reported would influence their participation in class discussion. Findings revealed that select factors within the classroom were favorably perceived by apprehensives as influencing their participation and perceived comfort with...

  • Interpersonal Communication in Education - Analysis and Systematisation of Research Directions. Bavčević, Tonči // Croatian Journal Educational / Hrvatski Casopis za Odgoj I Obraz;2016, Vol. 18 Issue 4, p1201 

    Interpersonal communication represents one of the most important aspects in the process of education. Its role may be seen at multiple levels. It can also be considered as a generator of interpersonal relations in the educational process as well as a consequence of the established interpersonal...

  • Can Human Relations Be Taught Through a Formalized Program? Perry, Cereta E. // Educational Leadership;Oct74, Vol. 32 Issue 1, p27 

    Argues that a formalized program stressing supportive behavior and a continuing dialogue in the classroom can enhance both learning and human relations. Types of learning that can be conducted in schools; Significance of an effective formalized program in a classroom; Promotion of human...

  • Establishing Trust in the Informal Classroom. Zeitz, Pearl // Education Digest;May1974, Vol. 39 Issue 9, p41 

    Presents the author's views on establishing trust with children in informal classrooms. View that the first step in establishing mutual trust is making clear to children exactly what expectations are; Information that there are some children who will have a harder time managing choices; View...

  • Features of the interaction of teachers with students classes with mixed composition ethnocultural. Huhlaeva, O. V. // Psychological Science & Education;2012, Issue 2, p71 

    Purpose of the article - identify the main difficulties in the interaction of teachers with students in classes with mixed ethnic and cultural composition. The author argues that students perceive the teacher inokulturnye less positively than the Russian. As one of the reasons he sees the...

  • Teachers' Attitudes Affect Children's Relationships. Frank, Lawrence K.; Frank, Mary H. // Education;Sep1954, Vol. 75 Issue 1, p6 

    This article discusses the influence of the attitude of teachers on the classroom relationship of children in the U.S. Children read and study about civic responsibilities in school but the subject remained vague in terms of actual deeds. It was said that schools stands as the only social group...

  • Mental Health and the Schoolroom. Odenwald, Robert P. // Education;Sep1954, Vol. 75 Issue 1, p18 

    The article focuses on the importance of the mental health of teacher to schoolroom environment. It was said that the welfare of the community depends on the emotional maturity and emotional well-being of the citizens. A good teacher-student relationship can contribute to the mental and...

  • COMMUNICATION AS AN ESSENTIAL ELEMENT OF PEDAGOGICAL PROCESS. Stonkuvienė, Irena // Bridges / Tiltai;2010, Vol. 53 Issue 4, p189 

    The article aims to commemorate the anniversary of L. Jovaiša, one of the most prominent Lithuanian educational scientists. The article analyses the conception of education by L. Jovaiša, which is seen as purposeful communication exchanging value information as well as its expression in...

  • More Than Relationship: Chinese Interaction and the Principle of Kuan-Hsi. Hui-Ching Chang; Holt, G. Richard // Communication Quarterly;Summer1991, Vol. 39 Issue 3, p251 

    Through an interpretive analysis of interviews of Chinese in Taiwan, it is demonstrated that the principle of kuan-hsi (relations) undergirds the functional aspects of Chinese interpersonal relationships. Originally based on the teachings of Confucian philosophy, and grounded in the notion of...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics