NPTE-PTA guideStudy & preparation
NPTE-PTA Reliability Questions: Compare Raters, Repeated Measures and Validity
Short answer
Classify a measurement question by the comparison it asks for: different examiners suggest interrater reliability, repeated ratings by one examiner suggest intrarater reliability, and comparison with another relevant measure can supply validity evidence. FSBPT includes reliability and validity in the NPTE-PTA content outline. Identify the study's purpose before choosing the label; the presence of a second examiner or instrument alone does not settle the answer.
Who is being compared: different raters or the same rater twice?
For NPTE-PTA measurement questions, identify whether the study compares different examiners, one examiner's repeated ratings, or a measure against a relevant comparator. FSBPT includes reliability and validity in its PTA content outline, effective January 2024 and checked November 11, 2026.
Start with the comparison, then name it. Interrater reliability concerns consistency across raters. Intrarater reliability concerns consistency within a rater across repeated assessments. In the simple practice designs below, assume the patient's condition stays stable and the specified procedure is followed.
Use this editorial worksheet before looking at the answer choices:
| Question to ask | What to record | What it helps distinguish |
|---|---|---|
| Who produces the ratings? | Different examiners or the same examiner | Between-rater versus within-rater comparison |
| When are ratings obtained? | Same assessment period or repeated occasions | Whether the examiner's own ratings are being repeated |
| What stays the same? | Patient condition, task and stated procedure | Whether a simple consistency comparison is supported |
| What is compared with what? | Ratings against ratings, or one measure against a relevant comparator | Reliability question versus possible validity evidence |
| What does the investigator want to establish? | The purpose stated in the stem | The actual question, rather than a keyword shortcut |
Write a sentence such as “The investigators compare different examiners' ratings of the same task.” Then select the term that matches that sentence. Term pairs like these are what the recall flashcards planned for NPTE-PTA prep are for. The NPTE-PTA content outline guide places this skill within the broader exam content.
What would a validity comparison ask instead?
A validity question goes beyond whether ratings repeat consistently. In the muscle-testing study discussed below, the investigators compared manual muscle testing with dynamometry to obtain validity evidence. The comparison concerned what the strength assessment represented, rather than only whether examiners repeated a rating.
For a practice stem, separate these two questions:
- Consistency: do examiners, or repeated assessments by one examiner, produce consistent ratings under the specified conditions?
- Validity evidence: how does the assessment relate to another relevant measure for the interpretation being investigated?
Do not automatically select validity whenever a stem mentions two instruments. Read what the researchers actually compare and why. Likewise, a single examiner can collect data for a validity study; “one examiner” does not make every study intrarater reliability.
Your next step is to underline the stated purpose. If the stem asks about consistency between examiners, answer that question even when an instrument is also mentioned. Explained answers planned for every NPTE-PTA prep question can help you see which comparison a stem was testing.
How did one muscle-testing study separate the three questions?
Paternostro-Sluga and colleagues published a primary study in the Journal of Rehabilitation Medicine in 2008. The source was checked November 14, 2026. It studied muscle testing in patients with chronic peripheral radial-innervated forearm weakness and separated the comparisons as follows:
| Study component | What the investigators did | Question illustrated |
|---|---|---|
| Interrater | Five examiners rated 31 patients | Consistency across different examiners |
| Intrarater | One examiner tested 22 patients twice, with a median interval of seven days | Consistency of that examiner's repeated ratings |
| Validity | Compared grip manual muscle testing with dynamometry | Evidence from comparison with another strength measure |
These are study procedures, not NPTE question counts or a recommended clinical testing schedule. The seven-day figure describes that study; it is not a universal requirement for intrarater assessment.
Use the table to practice identifying the comparison. Do not treat this one population and its standardized procedures as proof that a scale performs identically for every muscle, patient group or setting. The study is neither an official NPTE sample nor an FSBPT clinical guideline.
If your difficulty is assigning a muscle grade from an observed movement, use the separate manual muscle testing grades guide. Here, the task is to classify how measurements are compared.
What changes if the patient or testing method changes?
A repeated number is only useful to interpret in context. For the simple classification exercises here, patient stability and a consistent procedure are stated assumptions. If a stem instead says the patient's condition changed, do not silently assume the ratings describe an unchanged condition.
For example, two different ratings after a stated change in strength cannot, by themselves, tell you that the examiner was inconsistent. If positioning or instructions also change, record that difference before drawing a conclusion about the comparison.
Keep your answer within the information supplied. You may be able to name the intended study design without deciding whether its results establish strong reliability or validity. Naming a design does not establish the quality of its findings.
Before answering, complete: “The study is comparing ___; the stem does or does not hold ___ constant.” If a necessary detail is missing, avoid adding it from memory of a different question.
How do you classify three new measurement vignettes?
These are original teaching examples, not FSBPT items. Cover each answer and use the worksheet. The patient condition is assumed stable in the first two cases, and each examiner follows the stated procedure.
1. Different examiners, matching task. Two examiners independently rate the same patient's performance of the same manual muscle test. Investigators compare their ratings to assess consistency between examiners.
Answer: interrater reliability. The comparison is between raters. It does not ask whether one examiner repeats a rating or how the assessment relates to another strength measure.
2. One examiner, repeated assessment. One examiner rates a patient's performance, repeats the same assessment on another occasion and compares their own two ratings for consistency.
Answer: intrarater reliability. The repeated ratings come from the same examiner. Identify both parts: who repeats the assessment and what is being compared.
3. One examiner, two kinds of measurement. One examiner collects a manual grip-strength rating and a dynamometer measurement. Investigators examine their relationship as evidence for the interpretation of the manual rating.
Answer: a validity comparison. The purpose is the relationship to a relevant comparator. The fact that one examiner collected both measures does not turn this into a repeated-rating consistency question. The design alone does not prove universal validity.
For each miss, write the comparison you overlooked and explain why the closest alternative label does not fit. Fix It in full NPTE-PTA prep, planned for launch, collects those misses. Add that focused review to the free NPTE-PTA study plan. Use the 20 free NPTE-PTA practice questions for broader practice alongside these focused examples. Finish by classifying the three examples again without relying on their order.
Trust the source
Official sources
Exam policies can change. Use these primary sources for the most current details.