DIF Scoring Explained

JCAT Scoring System Explained

Understand exactly how CPSP scores the JCAT exam. DIF algorithm, Discrimination Index, excluded questions, mark redistribution, and what your score means relative to the pass mark.

How CPSP Scores the JCAT Exam

CPSP uses a Difficulty Index (DIF) scoring system for JCAT. This system analyses each question after the exam and removes questions that were either too easy or too hard, then redistributes their marks. Here is how it works step by step:

1️⃣

Step 1: Collect All Responses

After all candidates submit, CPSP collects all answer data for every question. The DIF algorithm cannot run until a statistically meaningful number of candidates have submitted.

2️⃣

Step 2: Calculate DIF for Every Question

DIF (Difficulty Index) = percentage of candidates who answered the question correctly. If 90% of candidates got Q1 right, its DIF is 0.90. If only 10% got Q2 right, its DIF is 0.10.

3️⃣

Step 3: Exclude Extreme Questions

Questions with DIF above 0.85 (too easy, discriminates nothing) or below 0.15 (too hard, discriminates nothing) are excluded from scoring. These questions are given zero weight.

4️⃣

Step 4: Redistribute Marks

The marks that would have gone to excluded questions are redistributed proportionally across the remaining (valid) questions. Each valid question now carries slightly more weight.

5️⃣

Step 5: Calculate Final Score

Your final JCAT score is your percentage of correct answers among the valid (non-excluded) questions, weighted by the redistributed marks. This score is compared against the pass mark.

6️⃣

Step 6: Pass or Fail Determination

If your weighted DIF-adjusted score is at or above 75%, you pass. Your national rank is also published based on the same weighted scores across all candidates who sat the exam.

Practical Implications of JCAT DIF Scoring

Why does DIF scoring matter for your preparation?
Because the pass mark and your actual score depend on how all other candidates perform, not just how many questions you answered correctly. Getting 75% of raw questions right does not guarantee you 75% after DIF adjustment. You need to aim for 80-82% on raw questions to be safe. NextStepMD's mock tests apply this same algorithm so your mock score is your most accurate JCAT predictor.
Does NextStepMD use the same DIF scoring as CPSP?
Yes. NextStepMD applies the identical DIF algorithm: questions with DIF above 85% or below 15% are excluded and marks redistributed. When you score 75% on a NextStepMD JCAT mock test after DIF adjustment, you are at the borderline of passing the real JCAT. A score of 80%+ puts you safely in the pass zone.
What is the Discrimination Index used in JCAT?
The Discrimination Index measures how well a question separates high-scoring from low-scoring candidates. A question that high scorers get right and low scorers get wrong has a high Discrimination Index (good question). A question that everyone gets right or wrong regardless of ability has a low Discrimination Index (excluded from scoring). NextStepMD shows you the Discrimination Index for every question in your item analysis report.

Practice with the Real JCAT Scoring System

NextStepMD is the only JCAT platform that applies the real CPSP DIF algorithm to every mock test. Know your true score before exam day.

Start Free Demo Test →