© 2018 - 2019 UEMS Cardio Section (UEMS-CS)

The EEGC Standard Setting Group

Chair and Deputy of the Standard Setting Group

Appointment

  • The Chair and Deputy are appointed by the Vice President for Training of the UEMS Cardiology Section / EEGC Board Chair
  • Tenure is for 2 years which may be renewed

Requirements

  • Active member of the EEGC question writing group
  • Detailed understanding of all aspects of Psychometrics and the Standards Setting process
  • Good leadership and IT skills

Responsibilities

  • In consultation with the EEGC board chair to appoint the members of the Standards Setting Group from the National Societies taking part in the EEGC to maintain an appropriate number of members
  • Ensures the Standards Setting Guide is up to date and that members are updated on the best practice for standards setting
  • To ensure that the pre-standards setting process using the on-line tool is completed by the members of the Group before the Standards Setting Meeting
  • To chair one Standards Setting Meeting each year
  • To facilitate discussion of items at the Standard Setting group meeting taking into account the pre-meeting scores of the members, to ensure sufficient involvement of both high and low scorers, and thereby allow the group to revise their scores following this discussion in accordance with the Standards Setting Guide
  • To review the performance of the Standard Setting meeting, along with item performance from previous exams and validates the final selection of 120 questions ensuring the EEGC exam blueprint is respected
  • To performs the required validation in the online tool so the final exam can be exported to PearsonVUE
  • To complete the EEGC Final Review check on the PearsonVUE system with the EEGC Chair
  • To receive the raw data 2 to 4 days after the EEGC exam
  • To forward the raw data to the statistician at the EEGC academic partner for the analysis
  • To review the initial data analysis to identify MCQs which may be performing poorly
  • To present the data on potentially poorly performing MCQs to the Standard Setting Group via teleconference web meeting and leads discussion on the exclusion of items from the exam
  • To instruct the statistician on any items to exclude prior to a rerun of the analysis. In collaboration with the statistician prepares the data and its analysis for presentation
  • To validate the final results and send them to Education Team so the information may be disseminated to the National Societies (which in turn share the results with their respective candidates)
  • To provide advice to the Chair of the Question Writing Group on topics to be prioritised in calls for new questions
  • To oversee the academic process for determining the pass mark
  • To provide a report to the EEGC board meeting and answer any questions from members to allow a pass mark to be agreed
  • The Chair to sit as a member on the EEGC Board
  • The Chair and/or Deputy attend the Kick-Off meeting at the ESC Congress

Members

Appointment

  • 8-12 members, including at least one cardiology trainee, are proposed by national societies and appointed by the EEGC board chair in consultation with the Chair of the Standards Setting Group
  • Tenure is for 2 years which may be renewed

Requirements

  • A detailed knowledge of best-of-five multiple choice examinations and the Standards Setting process
  • Good IT skills

Responsibilities

  • To perform the pre-standard setting process using the on-line tools before the Group Meetings
  • To attend the Group meeting once each year
  • To assess all questions with by the Group and agree the final standards setting
  • If a member is unable to attend a meeting, the Chair or Deputy will contact them to determine whether they want to remain a member of the Group

Meetings

  • The Group will meet routinely once each year in March
  • By agreement with the EEGC Chair and Standards Setting Group Chair, representatives of National Cardiology Societies may attend the Standards Setting Meeting to observe

Standard Setting Guide

  • To be developed

EEGC Final Review

  • Every question in the exam is checked for accuracy by the Chair of the Standards Setting Group and the EEGC Board Chair or appointed representatives. Any corrections are discussed and forwarded to the exam provider 4 weeks before the exam date.