Frame-of-reference training has been found to be particularly effective in eliminating:

Chapter 10: Ways to improve the performance appraisal system 1: Rater training

Category: Monograph Chapter Published: 29 Jun 2018

  • Abstract

It stands to reason that appraisers set to observe and evaluate employees using performance appraisal techniques will improve their performance through adequate and appropriate training. The challenges, however, we recall, include overcoming rater errors, feelings of discomfort with performance appraisal (PA), and the possibility of biases entering into the evaluation process due to preconceived perceptions and personal (political) agendas. Notably, the assumption underlying the training is that there is real transferability from the training class to the real situation at the organization. Moreover, if given a clear idea of what the performance dimensions mean and what different performance levels look like, raters will be more likely to show (more) agreement in their evaluations. In this chapter then, in addition to discussing these basic assumptions, we introduce the concept of frame-of-reference training (see also Chapter 13), designed basically to ensure that raters adopt a common frame of reference regarding target performance dimensions and performance levels. Additionally, we take a look at raters’ motivations as a source of rater error. Despite cynicism regarding the efficacy of training and the relative dearth of research, Tziner (2002) among others, upholds its virtues. To this end, the chapter includes a discussion of the content and methodology of training programs, a sample of a successful training model, and a brief review of current trends in rater training programs.

You are not authenticated to view the full text of this chapter or article.

Access options

Get access to the full article by using one of the access options below.

Email this content

Share Link


Copy this link, or click below to email it to a friend

Email this content

or copy the link directly:

The link was not copied. Your current browser may not support copying via this button.


Randomized Controlled Trial

. 2009 Sep;94(5):1336-44.

doi: 10.1037/a0016476.

Affiliations

  • PMID: 19702375
  • DOI: 10.1037/a0016476

Randomized Controlled Trial

Evaluating frame-of-reference rater training effectiveness using performance schema accuracy

C Allen Gorman et al. J Appl Psychol. 2009 Sep.

Abstract

Frame-of-reference training has been shown to be an effective intervention for improving the accuracy of performance ratings (e.g., Woehr & Huffcutt, 1994). Despite evidence in support of the effectiveness of frame-of-reference training, few studies have empirically addressed the ultimate goal of such training, which is to teach raters to share a common conceptualization of performance (Athey & McIntyre, 1987; Woehr, 1994). The present study tested the hypothesis that, following training, frame-of-reference-trained raters would possess schemas of performance that are more similar to a referent schema, as compared with control-trained raters. Schema accuracy was also hypothesized to be positively related to rating accuracy. Results supported these hypotheses. Implications for frame-of-reference training research and practice are discussed.

Similar articles

  • Using frame-of-reference training to understand the implications of rater idiosyncrasy for rating accuracy.

    Uggerslev KL, Sulsky LM. Uggerslev KL, et al. J Appl Psychol. 2008 May;93(3):711-9. doi: 10.1037/0021-9010.93.3.711. J Appl Psychol. 2008. PMID: 18457499

  • Can training improve the quality of inferences made by raters in competency modeling? A quasi-experiment.

    Lievens F, Sanchez JI. Lievens F, et al. J Appl Psychol. 2007 May;92(3):812-9. doi: 10.1037/0021-9010.92.3.812. J Appl Psychol. 2007. PMID: 17484560 Clinical Trial.

  • Frame-of-reference training effectiveness: effects of goal orientation and self-efficacy on affective, cognitive, skill-based, and transfer outcomes.

    Dierdorff EC, Surface EA, Brown KG. Dierdorff EC, et al. J Appl Psychol. 2010 Nov;95(6):1181-91. doi: 10.1037/a0020856. J Appl Psychol. 2010. PMID: 20853944

  • Transfer of management training from alternative perspectives.

    Taylor PJ, Russ-Eft DF, Taylor H. Taylor PJ, et al. J Appl Psychol. 2009 Jan;94(1):104-21. doi: 10.1037/a0013006. J Appl Psychol. 2009. PMID: 19186899 Review.

  • Policy capturing as an approach to understanding and improving performance appraisal: a review of the literature.

    Hobson CJ, Gibson FW. Hobson CJ, et al. Acad Manage Rev. 1983 Oct;8(4):640-9. Acad Manage Rev. 1983. PMID: 10299277 Review. No abstract available.

Cited by

  • Effectiveness of a simulation-based mastery learning to train clinicians on a novel cricothyrotomy procedure at an academic medical centre during a pandemic: a quasi-experimental cohort study.

    Issa N, Liddy WE, Samant S, Conley DB, Kern RC, Hungness ES, Cohen ER, Barsuk JH. Issa N, et al. BMJ Open. 2021 Nov 19;11(11):e054746. doi: 10.1136/bmjopen-2021-054746. BMJ Open. 2021. PMID: 34799364 Free PMC article.

  • Does effectiveness in performance appraisal improve with rater training?

    Rosales Sánchez C, Díaz-Cabrera D, Hernández-Fernaud E. Rosales Sánchez C, et al. PLoS One. 2019 Sep 19;14(9):e0222694. doi: 10.1371/journal.pone.0222694. eCollection 2019. PLoS One. 2019. PMID: 31536562 Free PMC article.

  • When less is more: validating a brief scale to rate interprofessional team competencies.

    Lie DA, Richter-Lagha R, Forest CP, Walsh A, Lohenry K. Lie DA, et al. Med Educ Online. 2017;22(1):1314751. doi: 10.1080/10872981.2017.1314751. Med Educ Online. 2017. PMID: 28475438 Free PMC article.

  • Regular Formal Evaluation Sessions are Effective as Frame-of-Reference Training for Faculty Evaluators of Clerkship Medical Students.

    Hemmer PA, Dadekian GA, Terndrup C, Pangaro LN, Weisbrod AB, Corriere MD, Rodriguez R, Short P, Kelly WF. Hemmer PA, et al. J Gen Intern Med. 2015 Sep;30(9):1313-8. doi: 10.1007/s11606-015-3294-6. J Gen Intern Med. 2015. PMID: 26173519 Free PMC article.

  • Effects of a rater training on rating accuracy in a physical examination skills assessment.

    Weitz G, Vinzentius C, Twesten C, Lehnert H, Bonnemeier H, König IR. Weitz G, et al. GMS Z Med Ausbild. 2014 Nov 17;31(4):Doc41. doi: 10.3205/zma000933. eCollection 2014. GMS Z Med Ausbild. 2014. PMID: 25489341 Free PMC article. Clinical Trial.

Publication types

MeSH terms

LinkOut - more resources

  • Full Text Sources

    • American Psychological Association
    • Ovid Technologies, Inc.

When conducting a performance appraisal What is the most important outcome?

Employees should come out of the appraisal wanting to do better on their duties and tasks. Improve work efficiency and productivity – This objective is one of the end results of employee appraisals. As a team leader, this should be your top priority as it reflects on your own performance.

What is the process of performance feedback?

Performance appraisal is defined as a process that systematically measures an employees personality and performance usually by managers or immediate supervisors against the predefined attributes like skillset, knowledge about the role, technical know-how, attitude, punctuality and so on.

Which of the following is most likely a true statement about relative and absolute judgment appraisal systems?

Which of the following is most likely a true statement about relative and absolute judgment appraisal systems? Absolute judgments allow for equal ratings among employees, but relative judgments do not.

What is the primary reason that most companies initially focus on with 360

The purpose of the 360-degree feedback is to assist each individual to understand their strengths and weaknesses and to contribute insights into aspects of their work that need professional development.