Browsing by Subject "Psychometrics"
Item Agreement between older adult patient and caregiver proxy symptom reports(Springer, 2022-05-14) Kroenke, Kurt; Stump, Timothy E.; Monahan, Patrick O.; Medicine, School of MedicineBackground: Proxy report is essential for patients unable to complete patient-reported outcome (PRO) measures themselves and potentially beneficial when the caregiver perspective can complement patient report. In this study, we examine agreement between self-report by older adults and proxy report by their caregivers when completing PROs for pain, anxiety, depression, and other symptoms/impairments. Methods: Four PROs were administered by telephone to older adults and their caregivers followed by re-administration within 24 h in a random subgroup. The PROs included the PHQ-9 depression, GAD-7 anxiety, PEG pain, and SymTrak multi-dimensional symptom and functional status scales. Results: The sample consisted of 576 older adult and caregiver participants (188 patient-caregiver dyads, 200 patients without identified caregiver). The four measures had good internal (Cronbach's alpha, 0.76 to 0.92) and test-retest (ICC, 0.63 to 0.92) reliability whether completed by patients or caregivers. Total score and item-level means were relatively similar for both patient and caregiver reports. Agreement for total score as measured by intraclass correlation coefficient (ICC) was better for SymTrak-23 (0.48) and pain (0.58) than for anxiety (0.28) and depression (0.25). Multinomial modeling showed higher (worse) patient-reported scale scores were associated with caregiver underreporting, whereas higher caregiver task difficulty was associated with overreporting. Conclusion: When averaged over individuals at the group level, proxy reports of PRO scores by caregivers tend to approximate patient reports. For individual patients, proxy report should be interpreted more cautiously for psychological symptoms as well as when patient-reported symptoms are more severe, or caregiver task difficulty is high.Item Assessment of Pediatric Chemotherapy-Induced Peripheral Neuropathy Using a New Patient-Reported Outcome Measure: The P-CIN(Sage, 2021) Smith, Ellen M. Lavoie; Kuisell, Clare; Kanzawa-Lee, Grace; Bridges, Celia M.; Cho, Youmin; Swets, Jenna; Renbarger, Jamie L.; Gilchrist, Laura S.; Medicine, School of MedicineBackground: Chemotherapy-induced peripheral neuropathy (CIPN) is commonly experienced by children receiving neurotoxic chemotherapy. No validated pediatric CIPN patient-reported outcome (PRO) measures exist. Purpose: To test sensitivity, internal consistency reliability, content and convergent validity, and feasibility of the Pediatric Chemotherapy-Induced Neuropathy (P-CIN), an electronic PRO measure for assessing CIPN in children who received neurotoxic chemotherapy. Method: Five experts evaluated content validity of the 14-item P-CIN. Children 5 to 17 years old with CIPN (N = 79) completed the P-CIN via tablet computer; a subset (n = 26) also underwent neurological examinations using the Pediatric-Modified Total Neuropathy Score. Following preliminary analyses, one item was deleted and three others modified. The revised P-CIN was retested with patients (n = 6) who also completed the Bruininks-Oseretsky Test of Motor Proficiency motor function assessment. Means, item response ranges, standard deviations, content validity indexes, Cronbach's alphas, and correlation coefficients were calculated. Results: Mean participant age was 11.25 (SD = 4.0) years. Most had acute leukemia (62.5%) and received vincristine (98.7%). Content validity index coefficients ranged from .80 to 1.0 (p = .05). For 9 of 14 items, responses ranged from 0 to 4 or 5; response ranges for toe numbness, pick up a coin, and three of four pain items were 0 to 3. After deleting one item, Cronbach's alpha coefficient was .83. P-CIN scores were strongly associated with Pediatric-Modified Total Neuropathy Score (r = .52, p < .01) and Bruininks-Oseretsky Test of Motor Proficiency (r = -.83, p = .04) scores. Sixty-eight percent of children 6 to 17 years old completed P-CIN independently. Discussion: Preliminary evidence suggests that the 13-item P-CIN is internally consistent, is valid, and can be completed independently by children ≥ 6 years. However, we recommend additional testing.Item Comparative responsiveness of pain outcome measures among primary care patients with musculoskeletal pain(Wolters Kluwer, 2010-11) Krebs, Erin E.; Bair, Matthew J.; Damush, Teresa M.; Tu, Wanzhu; Wu, Jingwei; Kroenke, Kurt; Department of Medicine, IU School of MedicineBACKGROUND: Comparative responsiveness data are needed to inform choices about pain outcome measures. OBJECTIVES: To compare responsiveness of pain intensity, pain-related function, and composite measures, using data from a randomized trial and observational study. RESEARCH DESIGN: Analysis of responsiveness. SUBJECTS: A total of 427 adults with persistent back, hip, or knee pain were recruited from primary care. METHODS: Participants completed Brief Pain Inventory, Chronic Pain Grade (CPG), Roland disability, SF-36 bodily pain, and pain global rating of change measures. We used the global rating as the anchor for standardized response mean and receiver operating characteristic curve analyses. We used the distribution-based standard error of measurement to estimate minimally important change. To assess responsiveness to the trial intervention, we evaluated standardized effect size statistics stratified by trial arm. RESULTS: All measures were responsive to global improvement and all had fair-to-good accuracy in discriminating between participants with and without improvement. SF bodily pain was less responsive than other measures in several analyses. The 3-item PEG was similarly responsive to full Brief Pain Inventory scales. CPG and SF bodily pain were less responsive to the trial intervention and did not perform well among participants with hip/knee pain. Agreement between anchor and distribution-based methods was modest. CONCLUSIONS: If a brief measure is desired, the 3-item PEG is more responsive than the SF bodily pain scale. CPG and SF bodily pain scales may be relatively poor choices for trial outcome assessment. Both anchor and distribution-based methods should be considered when determining clinically important change.Item Composite measures of pain, anxiety, and depressive (PAD) symptoms: Construct and predictive validity(Elsevier, 2021-09) Bushey, Michael A.; Kroenke, Kurt; Baye, Fitsum; Lourens, Spencer; Psychiatry, School of MedicineObjective Pain, anxiety, and depression (PAD) are common, co-occurring symptoms that adversely affect one another and may respond to common treatments. PAD composite measures would be useful for tracking treatment response in patients with PAD symptoms. The goal of this study is to compare 3 different PAD composite scales in terms of construct validity, responsiveness, and utility in predicting global improvement. Method The sample consisted of 294 primary care patients enrolled in a telecare trial for treating pain, anxiety, and depression. Assessments at baseline and 3 months included the Brief Pain Inventory, PHQ-9 depression scale, GAD-7 anxiety scale, PROMIS measures, Medical Outcomes Study Short-Form items, disability measures, and patient-reported global improvement. Construct validity of the PAD composite measures, their responsiveness, and their ability to predict global improvement was analyzed using Pearson correlations, standardized response means, and receiver operating characteristics analysis. Results PAD composite measures correlated strongly with one another, and moderately with measures of function, vitality, and disability. Each PAD composite measure demonstrated similar responsiveness in detecting improvement at 3 months as assessed by standardized response means (SRMs) and area under the curve (AUC analyses).The SRMs for partial and substantial global improvement corresponded to moderate (Cohen's d of 0.58 to 0.69) and large (0.81 to 0.93) effect sizes, respectively. Conclusions Three different PAD composite measures demonstrate good construct validity as well as responsiveness in detecting global improvement of pain, anxiety and depression at 3 months.Item Critical Synthesis Package: Interpersonal Reactivity Index (IRI)(2013) Konrath, Sara H.The IRI measures four different dimensions of dispositional empathy: 1) The Empathic Concern subscale assesses emotional empathy, or feelings of compassion for others in distress (e.g. “I often have tender, concerned feelings for people less fortunate than me.”) 2) The Perspective Taking subscale assesses cognitive empathy, or the tendency to see the world from others’ viewpoints (e.g. “I sometimes try to understand my friends better by imagining how things look from their perspective.”) 3) The Personal Distress subscale assesses self-focused responses to others’ suffering (e.g. “When I see someone who badly needs help in an emergency, I go to pieces.”) 4) The Fantasy subscale assesses empathy for fictional characters (e.g. “I really get involved with the feelings of the characters in a novel.”)Item Cultural Adaptation of the Bayley Scales of Infant and Toddler Development, 3rd Edition for use in Kenyan Children Aged 18–36 Months: A Psychometric Study(Elsevier, 2021) McHenry, Megan S.; Oyungu, Eren; Yang, Ziyi; Hines, Abbey C.; Ombitsa, Ananda R.; Vreeman, Rachel C.; Abubakar, Amina; Monahan, Patrick O.; Pediatrics, School of MedicineBackground: The Bayley Scales of Infant and Toddler Development, 3rd Edition (Bayley-III) is frequently used in international child development research. No studies examine its psychometric properties when culturally adapted within the Kenyan context. Aims: To culturally adapt the Bayley-III for use in Kenya and evaluate its validity and reliability. Methods and procedures: Forward and backward translation, cognitive interviews, and a brief pilot of culturally adapted items were performed. This psychometric study was part of another study on children born to mothers with HIV in Eldoret, Kenya. One hundred seventy-two children aged 18-36 months were assessed for cognition, receptive/expressive communication, and fine/gross motor domains using the Bayley-III. Confirmatory factor analysis (CFA), inter-scale Pearson correlations, internal consistency, t-tests, and test-retest reliability were performed. Outcomes and results: The mean age of children was 22.8 (SD 4.5) months old; 52.7 % (n = 89) were male. CFA revealed that both two- and three-factor indices had good and comparable fit. Pearson correlations were high between fine motor and receptive communication (r >0.70). Internal consistency was very strong for all of the subtests, with Cronbach coefficient alpha scores ranging from 0.88 to 0.96. Known groups/convergent validity was confirmed with stunting and parental concern for delays. Test-retest reliability was good and did not differ substantially across groups. Conclusions and implications: The Kenyan adapted Bayley-III is a psychometrically acceptable tool to assess child development. The scaled and composite scores should not be used to define Kenyan developmental norms, but it can be useful for comparing groups within research settings.Item Deriving a Measure of Social Recovery Capital From the Important People and Activities Instrument: Construction and Psychometric Properties(Oxford University Press, 2022) Francis, Meredith W.; Bourdon, Jessica L.; Chan, Grace; Dick, Danielle M.; Edenberg, Howard J.; Kamarajan, Chella; Kinreich, Sivan; Kramer, John; Kuo, Sally I-Chun; Pandey, Ashwini K.; Pandey, Gayathri; Smith, Rebecca L.; Bucholz, Kathleen K.; McCutcheon, Vivia V.; Psychiatry, School of MedicineAim: This study presents a measure of Social Recovery Capital (SRC) derived from the Important People and Activities instrument (IPA). Methods: The sample comprised young adults who participated in the Collaborative Study on the Genetics of Alcoholism, a high-risk family study of alcohol use disorder (N = 2472). Exploratory and confirmatory factor analysis identified influential items and factor structure, adjusting for family relatedness. The final scale was tested for reliability and validity. Results: Factor analysis retained 10 items loading on three factors (Network Abstinence Behaviors, Basic Network Structure and Network Importance) that together explained 42% of the variance in SRC. The total model showed adequate fit (Comparative Fit Index = 0.95; Tucker Lewis Index = 0.93; Root Mean Square Error of Approximation = 0.06; Standardized Root Mean Squared Residual = 0.05) and acceptable reliability (α = 0.60; McDonald's ω = 0.73) and correlated with validation measures mostly in the weak to moderate range. Due to variable factor scores for reliability and validity, we only recommend using the total score. Conclusion: The SRC-IPA is a novel measure of SRC derived from the IPA that captures social network data and has applications in research and clinical work. Secondary data analyses using the SRC-IPA in studies that collected the IPA can further demonstrate the interaction of SRC with a wide variety of clinical indicators and demographic characteristics, making it a valuable addition to other measures of SRC.Item Development and Preliminary Testing of the Collaboration for Innovation in Mentoring Survey: An Instrument of Nursing PhD Mentorship Quality(Elsevier, 2021) Smith, Asa B.; Umberfield, Elizabeth; Granner, Josephine R.; Harris, Melissa; Liestenfeltz, Bradley; Shuman, Clayton; Lavoie Smith, Ellen M.; School of NursingBackground: High-quality PhD nursing student mentorship facilitates student and program success. Extant literature recommends evaluating and improving mentorship to foster optimal PhD student development. However, a comprehensive measure capturing all aspects of mentorship salient to PhD nursing student wellbeing and success is not available. Objectives: The purpose of this pilot study was to develop a new instrument - the Collaboration for Leadership and Innovation in Mentoring (CLIM) - for quantifying important components of PhD student mentorship in nursing, and to preliminarily test its psychometric properties (content validity, sensitivity, test-retest reliability). Design: The study employed a cross-sectional design. Setting: The CLIM instrument was administered to nursing PhD students at a public state university in the United States. Participants: Sixteen nursing PhD students at various stages in their degree progression completed the instrument. Methods: PhD nursing students developed unique items based on qualitative data collected by the University using an Appreciative Inquiry framework. Seven nursing and non-nursing experts with experience in PhD mentorship evaluated content validity. After revisions, the final 44-item instrument was administered at two time points (one month apart) to allow assessment of test-retest reliability. Test-retest reliability was evaluated using Spearman-rank correlations and data from students with ≥1 year of experience with their mentor. Results: Response rates were 94% for both administrations (n = 16). The instrument's overall Content Validity Index (CVI) was 0.91 (p = 0.05). Test-retest analyses resulted in high correlations (r = 0.91, p < 0.001), further supporting reliability of the CLIM instrument. Conclusions: Preliminary evidence suggests that the CLIM instrument is a reliable instrument of PhD mentorship in nursing. However, additional testing in larger and more diverse graduate student populations is needed to evaluate internal consistency reliability, among other psychometric properties.Item Development and preliminary validation of the Brief Self-Compassion Inventory(Public Library of Science, 2023-05-12) Chinh, Kelly; Wu, Wei; Johns, Shelley A.; Stutz, Patrick V.; McGrew, John H.; Mosher, Catherine E.; Psychology, School of ScienceResearch and clinical interest in self-compassion has grown due to its associations with physical and mental health benefits. Widely used measures of self-compassion have conceptual and psychometric limitations that warrant attention. The purpose of this project was to develop a new self-compassion measure, the Brief Self-Compassion Inventory (BSCI), and test its psychometric properties. We developed items for the BSCI based on theory, prior research, and expert and cancer patient feedback. The BSCI was then tested with adults diagnosed with breast, gastrointestinal, lung, or prostate cancer (N = 404). Confirmatory factor analysis suggested a unidimensional structure, and internal consistency reliability was excellent. Construct validity of the BSCI was established through its correlations with psychological variables hypothesized to be related to self-compassion, such as mindfulness, acceptance of cancer, and other coping strategies. Furthermore, measurement invariance testing of the BSCI indicated that it could be used across patients of varying genders, cancer types, and stages of illness. In conclusion, the 5-item BSCI was determined to be psychometrically sound and suitable for use with adults of varying genders, cancer types, and stages of disease. The measure warrants testing with other medical and nonclinical populations.Item Differential patterns of gray matter volumes and associated gene expression profiles in cognitively-defined Alzheimer's disease subgroups(Elsevier, 2021) Groot, Colin; Grothe, Michel J.; Mukherjee, Shubhabrata; Jelistratova, Irina; Jansen, Iris; van Loenhoud, Anna Catharina; Risacher, Shannon L.; Saykin, Andrew J.; Mac Donald, Christine L.; Mez, Jesse; Trittschuh, Emily H.; Gryglewski, Gregor; Lanzenberger, Rupert; Pijnenburg, Yolande A.L.; Barkhof, Frederik; Scheltens, Philip; van der Flier, Wiesje M.; Crane, Paul K.; Ossenkoppele, Rik; Radiology and Imaging Sciences, School of MedicineThe clinical presentation of Alzheimer's disease (AD) varies widely across individuals but the neurobiological mechanisms underlying this heterogeneity are largely unknown. Here, we compared regional gray matter (GM) volumes and associated gene expression profiles between cognitively-defined subgroups of amyloid-β positive individuals clinically diagnosed with AD dementia (age: 66 ± 7, 47% male, MMSE: 21 ± 5). All participants underwent neuropsychological assessment with tests covering memory, executive-functioning, language and visuospatial-functioning domains. Subgroup classification was achieved using a psychometric framework that assesses which cognitive domain shows substantial relative impairment compared to the intra-individual average across domains, which yielded the following subgroups in our sample; AD-Memory (n = 41), AD-Executive (n = 117), AD-Language (n = 33), AD-Visuospatial (n = 171). We performed voxel-wise contrasts of GM volumes derived from 3Tesla structural MRI between subgroups and controls (n = 127, age 58 ± 9, 42% male, MMSE 29 ± 1), and observed that differences in regional GM volumes compared to controls closely matched the respective cognitive profiles. Specifically, we detected lower medial temporal lobe GM volumes in AD-Memory, lower fronto-parietal GM volumes in AD-Executive, asymmetric GM volumes in the temporal lobe (left < right) in AD-Language, and lower GM volumes in posterior areas in AD-Visuospatial. In order to examine possible biological drivers of these differences in regional GM volumes, we correlated subgroup-specific regional GM volumes to brain-wide gene expression profiles based on a stereotactic characterization of the transcriptional architecture of the human brain as provided by the Allen human brain atlas. Gene-set enrichment analyses revealed that variations in regional expression of genes involved in processes like mitochondrial respiration and metabolism of proteins were associated with patterns of regional GM volume across multiple subgroups. Other gene expression vs GM volume-associations were only detected in particular subgroups, e.g., genes involved in the cell cycle for AD-Memory, specific sets of genes related to protein metabolism in AD-Language, and genes associated with modification of gene expression in AD-Visuospatial. We conclude that cognitively-defined AD subgroups show neurobiological differences, and distinct biological pathways may be involved in the emergence of these differences.