|

|
 |
Julian, Ellen R. PhD; Ingersoll, Deborah J. PhD; Etienne, Patricia M.
EdD; Hilger, Anthony E, PhD. (2004). The Impact of Testing Accommodations
on MCAT Scores: Descriptive Results. Academic Medicine, 79;360-364.
PURPOSE: Medical College Admission Test (MCAT) examinees with
disabilities who receive accommodations receive flagged scores indicating
nonstandard administration. This report compares MCAT examinees who received
accommodations and their performances with standard examinees.
METHODS: Aggregate history records of all 1994-2000 MCAT
examinees were identified as flagged (2,401) or standard (297,880), then
further sorted by race/ethnicity (broadly identified as underrepresented
minority and non-URM, at the time of testing) and gender. Those with flagged
scores were also classified by disability (LD = learning disability, ADHD
= attention deficit hyperactivity disorder, LD/ADHD = learning disability
and attention deficit hyperactivity disorder, and Other = other disability)
and type of accommodation. Mean MCAT scores were calculated for all groups.
A group of 866 examinees took the MCAT first as a standard administration
and subsequently with accommodations. In a separate analysis, their two
sets of scores were compared.
RESULTS: Less than 1% of examinees (2,401) had accommodations;
of these, 55% were LD, 17% ADHD, 5% LD/ADHD, and 23% Other. Extended time
was the most frequently provided accommodation. Mean flagged scores slightly
exceeded mean standard scores on all MCAT sections. Examinees who retook
the MCAT with accommodations after a standard administration increased
their scores by six points, quadrupling the average gain by Standard-Standard
retest cohort from another study.
CONCLUSIONS: The small but statistically significant different
higher flagged scores may reflect either appropriate compensation or overly
generous accommodations. Extended time had a positive impact on the scores
of those who retested with this accommodation. The validity of the flagged
MCAT in predicting success in medical school is not known, and further
investigation is underway.
|