TITLE

USING COGNITIVE INTERVIEWS TO VALIDATE AN INTERPRETIVE ARGUMENT FOR THE ETS ISKILLS ASSESSMENT

AUTHOR(S)
Snow, Eric; Katz, Irvin R.
PUB. DATE
September 2009
SOURCE
Communications in Information Literacy;2009, Vol. 3 Issue 2, p99
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
Evaluating the trustworthiness of Internet-based or other digital information has become an essential 21st century skill. The iSkills� assessment, from Educational Testing Service (ETS), purports to measure such digital evaluation skills, along with other digital literacy skills. In this work, we use an argument-based approach to assessment validation to investigate the extent to which iSkills test scores can support inferences about the ability of college students to evaluate information in a digital environment. Eighty-eight undergraduates responded to iSkills assessment tasks and to more open-ended "naturalistic" tasks. These naturalistic tasks were designed to be like homework assignments that incorporate the critical evaluation of digital information. We observed weak-to-moderate correlations between scores, suggesting overlap in the skills assessed by the iSkills and the naturalistic tasks. Analyses of concurrent cognitive interviews (n=11 of 88) suggested distinctions between students' response processes to the assessment and naturalistic tasks. Although iSkills assessment tasks appear to elicit skills consistent with evaluation of digital information in the real world, students' responses to the naturalistic tasks demonstrated broader evaluation skills and less attention to the testing context. This study provides empirical validity evidence regarding ETS's iSkills assessment, as well as valuable insights into how undergraduates evaluate information in a digital environment.
ACCESSION #
52241848

 

Related Articles

  • A TWENTY YEAR PATH. Gilchrist, Debra L. // Communications in Information Literacy;2009, Vol. 3 Issue 2, p70 

    This article reviews the development of educational assessment from the 1970's to the present, including discussions of basic working definitions and models of assessment in information literacy. It reflects on what librarians have learned from assessment and about assessment, and how this...

  • Redefining Sources as Social Acts: Genre Theory in Information Literacy Instruction. Burkholder, Joel M. // Library Philosophy & Practice;Aug2010, p1 

    The article discusses genre theory in information literacy instruction. In her essay, Carolyn Miller defined genres as typified rhetorical actions based in recurrent events. Their full meaning reportedly depends on context and can only be understood by looking at the situation and the social...

  • Longitudinal update: business information literacy teaching at different academic levels. Hristova, Mariela; Miree, Cynthia E. // Journal of Information Literacy;Dec2013, Vol. 7 Issue 2, p153 

    The article presents information on business information literacy teaching at different academic levels. It contains tables showing the findings of several tests conducted on the students of information literacy, which include data on pre-test performance of final-year students, and comparison...

  • Information literacy in public libraries. Widdowson, Jacquie; Smart, Darren // Journal of Information Literacy;Dec2013, Vol. 7 Issue 2, p160 

    The article discusses information literacy (IL) in public libararies. It states that though readers do not mind it IL activity going on in libraries, but its an integral part of all public libraries. People may come across words like 'information skills' or 'research skills,' that are synonyms...

  • ALFABETIZACIÓN INFORMACIONAL EN LA EDUCACIÓN BÁSICA: EL CONCEPTO ADAPTADO A LA REALIDAD CHILENA. Salas Lamadrid, Consuelo // Serie Bibliotecología y Gestión de Información;2007, Issue 22, p1 

    This report reviews the historical development of the Information Literacy concept and its relation to libraries, librarians and primary school. It describes the state of art of school libraries in Basic Education and analizes the contents of Plans and Programs presented by the chilean Ministry...

  • Issues Related To Information Literacy Education in Malaysian Schools. Ismail, Saidatul Akmar; Dorner, Daniel; Oliver, Gillian // International Proceedings of Economics Development & Research;2011, Vol. 10, p204 

    Information literacy (IL) education in Malaysia is still at its infancy. Since 2002, IL implementation has been acknowledged by IL implementers and practitioners as evident from the education literature. However, the implementation of IL education remains difficult and not well researched. The...

  • The development of a model for teaching information literacy to nursing students through cross-professional collaboration. Nordsteien, Anita; Horntvedt, May-Elin Thengs; Holmen, Nina Therese // Nordic Journal of Information Literacy in Higher Education;2013, Vol. 5 Issue 1, p32 

    No abstract available.

  • Creating Criteria.  // School Librarian's Workshop;Jun/Jul2011, Vol. 31 Issue 6, p12 

    The article offers tips for librarians to help students develop the ability to validate information, an information literacy skill. Favorite picture books is suggested as a way of introducing the concept to elementary students. One activity for students is to rate books according to criteria....

  • Foundations of Information Literacy: Learning From Paul Zurkowski. Badke, William // Online;Jan/Feb2010, Vol. 34 Issue 1, p48 

    The article focuses on information literacy based on the definition by Paul G. Zurkowski, a lawyer and former president of the Information Industry Association. Zurkowski has stressed that people who can read and write but cannot apply information resources to their work must be regarded as...

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics