Browsing by Subject "psychometrics"
Item Agreement between older adult patient and caregiver proxy symptom reports(Springer, 2022-05) Kroenke, Kurt; Stump, Timothy E.; Monahan, Patrick O.; Medicine, School of MedicineBackground Proxy report is essential for patients unable to complete patient-reported outcome (PRO) measures themselves and potentially beneficial when the caregiver perspective can complement patient report. In this study, we examine agreement between self-report by older adults and proxy report by their caregivers when completing PROs for pain, anxiety, depression, and other symptoms/impairments. Methods Four PROs were administered by telephone to older adults and their caregivers followed by re-administration within 24 h in a random subgroup. The PROs included the PHQ-9 depression, GAD-7 anxiety, PEG pain, and SymTrak multi-dimensional symptom and functional status scales. Results The sample consisted of 576 older adult and caregiver participants (188 patient-caregiver dyads, 200 patients without identified caregiver). The four measures had good internal (Cronbach’s alpha, 0.76 to 0.92) and test–retest (ICC, 0.63 to 0.92) reliability whether completed by patients or caregivers. Total score and item-level means were relatively similar for both patient and caregiver reports. Agreement for total score as measured by intraclass correlation coefficient (ICC) was better for SymTrak-23 (0.48) and pain (0.58) than for anxiety (0.28) and depression (0.25). Multinomial modeling showed higher (worse) patient-reported scale scores were associated with caregiver underreporting, whereas higher caregiver task difficulty was associated with overreporting. Conclusion When averaged over individuals at the group level, proxy reports of PRO scores by caregivers tend to approximate patient reports. For individual patients, proxy report should be interpreted more cautiously for psychological symptoms as well as when patient-reported symptoms are more severe, or caregiver task difficulty is high.Item Comparative responsiveness and minimally important difference of Fatigue Symptom Inventory (FSI) scales and the FSI-3 in trials with cancer survivors(Springer, 2022-07) Mosher, Catherine E.; Secinti, Ekin; Johns, Shelley A.; Kroenke, Kurt; Rogers, Laura O.; Psychology, School of ScienceBackground Fatigue is a highly prevalent and disabling symptom in cancer survivors. Although many measures have been developed to assess survivors’ fatigue, their ability to accurately capture change following intervention has rarely been assessed in post-treatment survivors. Ultra-brief fatigue measures are preferable in clinical practice but have limited evidence supporting their use with cancer survivors. We examined the psychometric properties of four Fatigue Symptom Inventory (FSI) measures, including the new FSI-3, in cancer survivors. Examined properties included responsiveness to change and minimally important differences (MIDs). Methods We analyzed data from three randomized controlled trials with post-treatment cancer survivors (N = 328). Responsiveness to change was evaluated by comparing standardized response means for survivors who reported their fatigue as being better, the same, or worse at 2–3 months. Responsiveness to intervention was assessed via effect sizes, and MIDs were estimated by using several methods. We also computed area under the curve (AUC) values to assess FSI measures’ discriminative accuracy compared to an established cut-point. Results All FSI measures differentiated survivors who reported improvement at 2–3 months from those with stable fatigue, but did not uniformly differentiate worsening fatigue from stable fatigue. Measures showed similar levels of responsiveness to intervention, and MIDs ranged from 0.29 to 2.20 across FSI measures. AUC analyses supported the measures’ ability to detect significant fatigue. Conclusions Four FSI scales show similar responsiveness to change, and estimated MIDs can inform assessment of meaningful change in fatigue. The FSI-3 shows promise as an ultra-brief fatigue measure for survivors.Item Comparative Responsiveness of Pain Measures in Cancer Patients(Elsevier, 2012-08) Kroenke, Kurt; Theobald, Dale; Wu, Jingwei; Tu, Wanzhu; Krebs, Erin E.; Department of Medicine, IU School of MedicineBrief measures to assess and monitor pain in cancer patients are available, but few head-to-head psychometric comparisons of different measures have been reported. Baseline and 3-month data were analyzed from 274 patients enrolled in the Indiana Cancer Pain and Depression (INCPAD) trial. Participants completed the Brief Pain Inventory (BPI), the PEG (a 3-item abbreviated version of the BPI), the short form (SF)-36 pain scale, and a pain global rating of change measure. The global rating was used as the criterion for standardized response mean and receiver operating characteristic curve analyses. To assess responsiveness to the trial intervention, we evaluated standardized effect size statistics stratified by trial arm. All measures were responsive to global improvement, discriminated between participants with and without improvement, and detected a significant intervention treatment effect. Short and longer measures were similarly responsive. Also, composite measures that combined pain severity and interference into a single score (BPI total, PEG, SF-36 pain) performed comparably to separate measures of each domain (BPI severity and BPI interference).Item Core Outcome Measures for Chronic Musculoskeletal Pain Research: Recommendations from a Veterans Health Administration Work Group(Oxford, 2019-08) Kroenke, Kurt; Krebs, Erin E.; Turk, Dennis; Von Korff, Michael; Bair, Matthew J.; Allen, Kelli D.; Sandbrink, Friedhelm; Cheville, Andrea L.; DeBar, Lynn; Lorenz, Karl A.; Kerns, Robert D.; Medicine, School of MedicineObjective Chronic musculoskeletal pain (CMSP) disorders are among the most prevalent and disabling conditions worldwide. It would be advantageous to have common outcome measures when comparing results across different CMSP research studies. Methods The Veterans Health Administration appointed a work group to recommend core outcome measures for assessing pain intensity and interference as well as important secondary domains in clinical research. The work group used three streams of data to inform their recommendations: 1) literature synthesis augmented by three recently completed trials; 2) review and comparison of measures recommended by other expert groups; 3) two Delphi surveys of work group members. Results The single-item numerical rating scale and seven-item Brief Pain Inventory interference scale emerged as the recommended measures for assessing pain intensity and interference, respectively. The secondary domains ranked most important included physical functioning and depression, followed by sleep, anxiety, and patient-reported global impression of change (PGIC). For these domains, the work group recommended the Patient-Reported Outcome Information System four-item physical function and sleep scales, the Patient Health Questionnaire two-item depression scale, the Generalized Anxiety Disorder two-item anxiety scale, and the single-item PGIC. Finally, a single-item National Health Interview Survey item was favored for defining chronic pain. Conclusions Two scales comprising eight items are recommended as core outcome measures for pain intensity and interference in all studies of chronic musculoskeletal pain, and brief scales comprising 13 additional items can be added when possible to assess important secondary domains.Item Development and Testing of the Dysmenorrhea Symptom Interference (DSI) Scale(2020-07-17) Chen, Chen X.; Murphy, Tabitha; Ofner, Susan; Yahng, Lilian; Krombach, Peter; LaPradd, Michelle; Bakoyannis, Giorgos; Carpenter, Janet S.; School of NursingDysmenorrhea affects most reproductive-age women and increases the risk of future pain. To evaluate dysmenorrhea interventions, validated outcome measures are needed. In this two-phase study, we developed and tested the dysmenorrhea symptom interference scale. During the scale-development phase (n = 30), we created a nine-item scale based on qualitative data from cognitive interviews. During the scale-testing phase (n = 686), we evaluated reliability, validity, and responsiveness to change. The scale measures how dysmenorrhea symptoms interfere with physical, mental, and social activities. Internal consistency was strong with Cronbach's α > 0.9. Test-retest reliability was acceptable (r = 0.8). The scale showed satisfactory content validity, construct validity (supported by confirmatory factor analysis), concurrent validity, and responsiveness to change. The minimally important difference was 0.3 points on a scale with a possible total score ranging from 1 to 5. This new psychometrically sound scale can be used in research and clinical practice to facilitate the measurement and management of dysmenorrhea.Item Development of a Short Version of the Cataldo Lung Cancer Stigma Scale(Taylor and Francis, 2015) Carter-Harris, Lisa; Hall, Lynne A.; IU School of NursingLung cancer stigma is an important phenomenon experienced by many lung cancer patients that can be a barrier to medical help-seeking behavior. The purpose of this study was to shorten the Cataldo Lung Cancer Stigma Scale (CLCSS). The original 31-item scale had excellent internal consistency reliability but item redundancy. The majority of lung cancer patients are diagnosed at an advanced stage, and patient burden with survey completion may be higher in this population. To reduce patient burden with participation in lung cancer stigma-related research, a psychometrically sound short measure of lung cancer stigma is valuable. Factor analysis was used to evaluate the dimensionality of the CLCSS. Results were used to shorten the measure to 21 items. The shortened scale showed strong evidence of internal consistency reliability (Cronbach's alpha =.93). Results also indicate the scale is three dimensional with reliable subscales: stigma and blame, social isolation, and discrimination.Item PROMIS 4-item measures and numeric rating scales efficiently assess SPADE symptoms compared with legacy measures(Elsevier, 2019-11) Kroenke, Kurt; Stump, Timothy E.; Kean, Jacob; Talib, Tasneem L.; Haggstrom, David A.; Monahan, Patrick O.; Medicine, School of MedicineObjective The 5 SPADE (sleep, pain, anxiety, depression, and low energy/fatigue) symptoms are among the most prevalent and disabling symptoms in clinical practice. This study evaluates the minimally important difference (MID) of Patient-Reported Outcomes Measurement Information System (PROMIS) measures and their correspondence with other brief measures to assess SPADE symptoms. Study Design and Setting Three hundred primary care patients completed a 4-item PROMIS scale, a numeric rating scale (NRS), and a non-PROMIS legacy scale for each of the 5 SPADE symptoms. Optimal NRS cutpoints were examined, and cross-walk units for converting legacy measure scores to PROMIS scores were determined. PROMIS scores corresponding to standard deviation (SD) and standard error of measurement (SEM) changes in legacy scores were used to estimate MID. Results At an NRS ≥5, the mean PROMIS T-score exceeded 55 (the operational threshold for a clinically meaningful symptom) for each SPADE symptom. Correlations were high (0.70–0.86) between each PROMIS scale and its corresponding non-PROMIS legacy scale. Changes in non-PROMIS legacy scale scores of 0.35 SD and 1 SEM corresponded to mean PROMIS T-scores of 2.92 and 3.05 across the 5 SPADE symptoms, with changes in 0.2 and 0.5 SD corresponding to mean PROMIS T-scores of 1.67 and 4.16. Conclusion A 2-step screening process for SPADE symptoms might use single-item NRS scores, proceeding to PROMIS scales for NRS scores ≥5. A PROMIS T-score change of three points represents a reasonable MID estimate, with two to four points approximating lower and upper bounds.Item A Psychometric Evaluation of Script Concordance Tests for Measuring Clinical Reasoning(2013-06) Wilson, Adam Benjamin; Pike, Gary R. (Gary Robert), 1952-; Humbert, Aloysius J.; Brokaw, James J.; Seifert, Mark F.Purpose: Script concordance tests (SCTs) are assessments purported to measure clinical data interpretation. The aims of this research were to (1) test the psychometric properties of SCT items, (2) directly examine the construct validity of SCTs, and (3) explore the concurrent validity of six SCT scoring methods while also considering validity at the item difficulty and item type levels. Methods: SCT scores from a problem solving SCT (SCT-PS; n=522) and emergency medicine SCT (SCT-EM; n=1040) were used to investigate the aims of this research. An item analysis was conducted to optimize the SCT datasets, to categorize items into levels of difficulty and type, and to test for gender biases. A confirmatory factor analysis tested whether SCT scores conformed to a theorized unidimensional factor structure. Exploratory factor analyses examined the effects of six SCT scoring methods on construct validity. The concurrent validity of each scoring method was also tested via a one-way multivariate analysis of variance (MANOVA) and Pearson’s product moment correlations. Repeated measures analysis of variance (ANOVA) and one-way ANOVA tested the discriminatory power of the SCTs according to item difficulty and type. Results: Item analysis identified no gender biases. A combination of moderate model-fit indices and poor factor loadings from the confirmatory factor analysis suggested that the SCTs under investigation did not conform to a unidimensional factor structure. Exploratory factor analyses of six different scoring methods repeatedly revealed weak factor loadings, and extracted factors consistently explained only a small portion of the total variance. Results of the concurrent validity study showed that all six scoring methods discriminated between medical training levels in spite of lower reliability coefficients on 3-point scoring methods. In addition, examinees as MS4s significantly (p<0.001) outperformed their MS2 SCT scores in all difficulty categories. Cross-sectional analysis of SCT-EM data reported significant differences (p<0.001) between experienced EM physicians, EM residents, and MS4s at each level of difficulty. When considering item type, diagnostic and therapeutic items differentiated between all three training levels, while investigational items could not readily distinguish between MS4s and EM residents. Conclusions: The results of this research contest the assertion that SCTs measure a single common construct. These findings raise questions about the latent constructs measured by SCTs and challenge the overall utility of SCT scores. The outcomes of the concurrent validity study provide evidence that multiple scoring methods reasonably differentiate between medical training levels. Concurrent validity was also observed when considering item difficulty and item type.Item Psychometric Testing of the Life Changes in Epilepsy Scale(Springer, 2017) Miller, Wendy Renee; Weaver, Michael; Bakoyannis, Giorgos; Bakas, Tamilyn; Buelow, Janice; Sabau, Dragos; School of NursingPurpose: Three aims were addressed: (a) Evaluate properties of the items comprising the Life Changes in Epilepsy Scale-Pilot (LCES-P), (b) use item analysis to optimize the scale, (c) evaluate construct and criterion-related validity of the optimized LCES. Methods: The LCES-P was administered to 174 adults with epilepsy. Item analysis and exploratory factor analysis were performed. Internal consistency reliability, construct validity, and criterion-related validity were evaluated. Results: 17 items were retained in the optimized LCES. Internal consistency reliability was supported. Path analysis was used to evaluate construct validity. Criterion-related validity was supported by correlations with the Medical Outcomes SF-36 Survey (SF-36) General Health subscale and a criterion variable. Conclusions: The optimized version of the LCES can serve as a valuable outcome measure in clinical and research environments.Item Psychometric Testing of the Smoking Cessation Counseling Scale among Magnet® Hospital Nurses(Sage, 2017-04) Liu, Wen; Johantgen, Meg; Newhouse, Robin; School of NursingPsychometrics of the Smoking Cessation Counseling Scale, which measures adherence to evidence-based smoking cessation counseling practice, were originally estimated among rural hospital nurses. The purpose of this study was to estimate the scale’s reliability, convergent validity, and factor structure among 289 nurses from 27 acute care Magnet® hospitals. The scale demonstrated acceptable estimates for internal consistency (Cronbach’s α = .95, 95% CI = [0.94, 0.96]). Convergent validity was supported by the association with comfort in conducting smoking cessation counseling (coefficient = 3.58, 95% CI = [2.80, 4.37]) and shared vision (coefficient = 0.72, 95% CI = [0.02, 1.42]). A four-factor structure (standard care, basic counseling, advanced counseling, and referral to services) was identified. Findings supported the scale’s reliability and convergent validity among Magnet® hospital nurses. Further testing is needed to confirm the four-factor structure and accumulate psychometric evidence among different nursing providers and health care settings to expand the use of the instrument.