SJT alternate response captureThere are other ways of capturing and scoring responses for SJT questions. Up until recently, the predominant method was using Dev & Metcalf's ranked order with 5 response options, as we have seen in other nodes in this case. But as described by de Leng at al in 2011, you can use Likert scales to rate the 5 responses. In their study, they used 4-point Likert scales but they pointed out that this created some issues. We illustrate here some ways of capturing the response options, using Likert scales and sliders. Stem: it can be important in SJT scenarios to decide how best to capture and score your responses. Small variations can make a big difference to the candidate's overall exam score. Consider the following factors: **insert 4 point Likert Rate each response **insert 4 point Slider It does not really matter because the outcome will be the same regardless Rate this response 1
4
I think that there should be more than 4 levels of response agreement Rate this response 1
4
I believe that it is important NOT to have a neutral/middle choice Rate this response 1
4
I don't think that people pay attention to the least important choices Rate this response 1
4
Rating a response equally is a good option to have - not all responses can be ranked Rate this response 1
4
As de Leng et al noted, having only 4 levels of rating can be a limitation. What about having a 7-point Likert or a 100-point Slider as alternative score capture mechanisms. **insert 100-point sliders It does not really matter because the outcome will be the same regardless Rate this response 1
100
I think that there should be more than 4 levels of response agreement Rate this response 1
100
I believe that it is important NOT to have a neutral/middle choice Rate this response 1
100
I don't think that people pay attention to the least important choices Rate this response 1
100
Rating a response equally is a good option to have - not all responses can be ranked Rate this response 1
100
But you can also quite simply introduce a greater/finer degree of granularity, with Likert scales or with Sliders. **insert 7 point Likert **insert 7 zone slider **inserted 10 segment slider **insert 100 point slider Remember that the main difference between an SJT question and a Drag&Drop question is in the reporting phase and how the scores are calculated. |
Map: SJT demo (284)
|
||
Review your pathway |