Validity, reliability, and responsiveness to change of the “Osteoporosis and You” knowledge scale

Summary: We studied the Osteoporosis and You knowledge scale in 7749 participants enrolled in a clinical trial. Results confirmed its psychometric properties in a diverse audience. Baseline scores were associated with better recall of bone mineral density test results at follow-up; however, the scale was not responsive to knowledge change. Introduction: The goal of this study was to confirm the measurement properties of the Osteoporosis and You (O&Y) knowledge scale using classic test theory methods in the 7749 men and women participating in the Patient Activation After DXA Result Notification (PAADRN) randomized controlled trial. We hypothesized a simple factor structure that would reflect the four-factor model previously published. Methods: We conducted psychometric analyses which included item analysis, internal consistency reliability, construct validity using exploratory and confirmatory factor analysis (EFA and CFA), comparing knowledge levels across pre-specified groups, and responsiveness to change. Results: PAADRN participants were predominantly college educated, White females with low bone density, and a moderate level of 10-year fracture risk. EFA revealed four domains closely matching those in two previous reports. While overall scale reliability was minimally acceptable at 0.68, the reliabilities of the domain subscales were unacceptably low (0.59, 0.64, 0.45, and 0.36 for the Biological, Lifestyle, Consequences, and Prevention and Treatment subscales). CFA revealed the data fit the hypothesized model reasonably well with the items loading on their expected latent variable. The scale was not responsive to change, but although not significant, improved knowledge indicated better DXA result recall at 12 and 52 weeks. Conclusions: In the PAADRN population, the O&Y knowledge scale had psychometric properties similar to those previously reported. Over 12 and 52 weeks, participants did not demonstrate significant changes in knowledge, but those with higher knowledge at baseline were more likely to accurately recall their baseline DXA result.