Development of the AGREE II, part 2: assessment of validity of items and tools to support application

Brouwers, Melissa C.; Kho, Michelle E.; Browman, George P.; Burgers, Jako S.; Cluzeau, Françoise; Feder, Gene; Fervers, Béatrice; Graham, Ian D.; Hanna, Steven E.; Makarski, Julie
July 2010
CMAJ: Canadian Medical Association Journal;7/13/2010, Vol. 182 Issue 10, pE472
Academic Journal
Background: We established a program of research to improve the development, reporting and evaluation of practice guidelines. We assessed the construct validity of the items and user's manual in the β version of the AGREE II. Methods: We designed guideline excerpts reflecting highand low-quality guideline content for 21 of the 23 items in the tool. We designed two study packages so that one low-quality and one high-quality version of each item were randomly assigned to each package. We randomly assigned 30 participants to one of the two packages. Participants reviewed and rated the guideline content according to the instructions of the user's manual and completed a survey assessing the manual. Results: In all cases, content designed to be of high quality was rated higher than low-quality content; in 18 of 21 cases, the differences were significant (p < 0.05). The manual was rated by participants as appropriate, easy to use, and helpful in differentiating guidelines of varying quality, with all scores above the mid-point of the seven-point scale. Considerable feedback was offered on how the items and manual of the β-AGREE II could be improved. Interpretation: The validity of the items was established and the user's manual was rated as highly useful by users. We used these results and those of our study presented in part 1 to modify the items and user's manual. We recommend AGREE II (available at www .agreetrust .org) as the revised standard for guideline development, reporting and evaluation.


Related Articles

  • Development of the AGREE II, part 1: performance, usefulness and areas for improvement. Brouwers, Melissa C.; Kho, Michelle E.; Browman, George P.; Burgers, Jako S.; Cluzeau, Francoise; Feder, Gene; Fervers, Béatrice; Graham, Ian D.; Hanna, Steven E.; Makarski, Julie // CMAJ: Canadian Medical Association Journal;7/13/2010, Vol. 182 Issue 10, p1045 

    Background: We undertook research to improve the AGREE instrument, a tool used to evaluate guidelines. We tested a new seven-point scale, evaluated the usefulness of the original items in the instrument, investigated evidence to support shorter, tailored versions of the tool, and identified...

  • How to really tick off your boss Use this checklist before heading to the meeting. Leemann, James E. // Industrial Safety & Hygiene News;Apr2012, Vol. 46 Issue 4, p22 

    The article provides ways to tick off chief executive officers (CEOs) and how to avoid them during meetings. These include unpreparedness, presentation of spin and half truths as well as lack of impact awareness throughout the organization. It also notes that the following can be prevented...

  • Handle With Care. Koco, Linda // National Underwriter / Life & Health Financial Services;3/10/2008, Vol. 112 Issue 9, p36 

    The article reflects the author's view on the validity of polls and surveys on a particular product. He opines that polls and surveys can be useful to insurance and financial services industry but due care is needed to ascertain veracity of the results. He notes that it is well known that some...

  • How to Conduct Self Directed 360. Ludeman, Kate // Training & Development;Jul2000, Vol. 54 Issue 7, p44 

    Discusses how companies can implement the Self-Directed 360, a form performance appraisal where feedbacks above, below and around an employee are collected. Initiation of the process by employers or employees; Feedback on predetermined competencies; Need for commitment to hearing the truth.

  • TRAINING SEQUENCE. Rodgers, Mark // Motorcycle Product News;Jun2009, Vol. 35 Issue 6, p42 

    The article presents the step-by-step methods for effective dealership sales training in the U.S. These steps will help dealers manage and motivate effectively towards their main objective. These steps include the discussion of the why behind the importance of sales training, give clear and...

  • Assessment of psychiatrists in practice through multisource feedback. Violato, Claudio; Lockyer, Jocelyn M.; Fidler, Herta // Canadian Journal of Psychiatry;Aug2008, Vol. 53 Issue 8, p525 

    Objective: To assess the feasibility and evidence for the reliability and validity of a set of questionnaires for psychiatrists, given that multisource feedback (MSF) or 360 degrees evaluation allows medical colleagues, coworkers, and patients to provide feedback about competencies...

  • Factors inuencing managers' decisions to continue/discontinue capital budgeting projects. Ibrahim, Mohamed E. // Electronic Journal of Applied Statistical Analysis;Oct2016, Vol. 9 Issue 3, p540 

    Normative decision theories stipulate that rational economic decisions (in- cluding investment decisions) are made based on the assessment of the ex- pected outcomes. Accordingly, if available feedback information about an investment project indicates at any given point in time that the expected...

  • Who Is Telling the Truth? A Validation Study on Determinants of Response Behavior in Surveys. Preisendörfer, Peter; Wolter, Felix // Public Opinion Quarterly;Spring2014, Vol. 78 Issue 1, p126 

    Based on two individual validation studies employing face-to-face interviews and a mail survey, this article investigates factors influencing the probability that respondents truthfully admit to having been convicted of a criminal offense. Overall, 63 percent of the 495 respondents stuck to the...


    Online survey methods and online access panels are commonly used in both academic and private industry research. However, many industry reviews indicate the presence of fraudulent and inattentive online panel participants who pose a threat to data validity, with estimates of 8-25 percent of the...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics