SJT alternate response capture

There are other ways of capturing and scoring responses for SJT questions. 

Up until recently, the predominant method was using Dev & Metcalf's ranked order with 5 response options, as we have seen in other nodes in this case.  

But as described by de Leng at al in 2011, you can use Likert scales to rate the 5 responses. In their study, they used 4-point Likert scales but they pointed out that this created some issues. info

We illustrate here some ways of capturing the response options, using Likert scales and sliders. 

Stem: it can be important in SJT scenarios to decide how best to capture and score your responses. Small variations can make a big difference to the candidate's overall exam score. Consider the following factors:

**insert 4 point Likert

Rate each response

Strong disagree Disagree Agree Strongly agree
It does not really matter because the outcome will be the same regardless
I think that there should be more than 4 levels of response agreement
I believe that it is important NOT to have a neutral/middle choice
I don't think that people pay attention to the least important choices
Rating a response equally is a good option to have - not all responses can be ranked

**insert 4 point Slider

It does not really matter because the outcome will be the same regardless

Rate this response

1
4

I think that there should be more than 4 levels of response agreement

Rate this response

1
4

I believe that it is important NOT to have a neutral/middle choice

Rate this response

1
4

I don't think that people pay attention to the least important choices

Rate this response

1
4

Rating a response equally is a good option to have - not all responses can be ranked

Rate this response

1
4

As de Leng et al noted, having only 4 levels of rating can be a limitation. What about having a 7-point Likert or a 100-point Slider as alternative score capture mechanisms. 

**insert 100-point sliders

It does not really matter because the outcome will be the same regardless

Rate this response

1
100

I think that there should be more than 4 levels of response agreement

Rate this response

1
100

I believe that it is important NOT to have a neutral/middle choice

Rate this response

1
100

I don't think that people pay attention to the least important choices

Rate this response

1
100

Rating a response equally is a good option to have - not all responses can be ranked

Rate this response

1
100


But you can also quite simply introduce a greater/finer degree of granularity, with Likert scales or with Sliders. 

**insert 7 point Likert

**insert 7 zone slider

**inserted 10 segment slider

**insert 100 point slider

Remember that the main difference between an SJT question and a Drag&Drop question is in the reporting phase and how the scores are calculated. 

>>END case

    Map: SJT demo (284)
    Node: 54423
    Score:

    reset

    OpenLabyrinth
    OpenLabyrinth is an open source educational pathway system

    Review your pathway

    • Start of Rotation
    • SJT alternate response capture

    Reminder

    empty_reminder_msg

    FINISH

    Time is up

    Debbuger window

    =

    Previous_value: