Browsing by Subject "Reliable change"

Now showing 1 - 6 of 6
  • Thumbnail Image
    Item
    Application of Different Standard Error Estimates in Reliable Change Methods
    (Oxford University Press, 2021) Hammers, Dustin B.; Duff, Kevin; Neurology, School of Medicine
    Objective: This study attempted to clarify the applicability of standard error (SE) terms in clinical research when examining the impact of short-term practice effects on cognitive performance via reliable change methodology. Method: This study compared McSweeney's SE of the estimate (SEest) to Crawford and Howell's SE for prediction of the regression (SEpred) using a developmental sample of 167 participants with either normal cognition or mild cognitive impairment (MCI) assessed twice over 1 week. One-week practice effects in older adults: Tools for assessing cognitive change. Using these SEs, previously published standardized regression-based (SRB) reliable change prediction equations were then applied to an independent sample of 143 participants with MCI. Results: This clinical developmental sample yielded nearly identical SE values (e.g., 3.697 vs. 3.719 for HVLT-R Total Recall SEest and SEpred, respectively), and the resultant SRB-based discrepancy z scores were comparable and strongly correlated (r = 1.0, p < .001). Consequently, observed follow-up scores for our sample with MCI were consistently below expectation compared to predictions based on Duff's SRB algorithms. Conclusions: These results appear to replicate and extend previous work showing that the calculation of the SEest and SEpred from a clinical sample of cognitively intact and MCI participants yields similar values and can be incorporated into SRB reliable change statistics with comparable results. As a result, neuropsychologists utilizing reliable change methods in research investigation (or clinical practice) should carefully balance mathematical accuracy and ease of use, among other factors, when determining which SE metric to use.
  • Thumbnail Image
    Item
    Assessing and validating reliable change across ADNI protocols
    (Taylor & Francis, 2022) Hammers, Dustin B.; Kostadinova, Ralitsa; Unverzagt, Frederick W.; Apostolova, Liana G.; Alzheimer’s Disease Neuroimaging Initiative; Neurology, School of Medicine
    Objective: Reliable change methods can aid in determining whether changes in cognitive performance over time are meaningful. The current study sought to develop and cross-validate 12-month standardized regression-based (SRB) equations for the neuropsychological measures commonly administered in the Alzheimer's Disease Neuroimaging Initiative (ADNI) longitudinal study. Method: Prediction algorithms were developed using baseline score, retest interval, the presence/absence of a 6-month evaluation, age, education, sex, and ethnicity in two different samples (n = 192 each) of robustly cognitively intact community-dwelling older adults from ADNI - matched for demographic and testing factors. The developed formulae for each sample were then applied to one of the samples to determine goodness-of-fit and appropriateness of combining samples for a single set of SRB equations. Results: Minimal differences were seen between Observed 12-month and Predicted 12-month scores on most neuropsychological tests from ADNI, and when compared across samples the resultant Predicted 12-month scores were highly correlated. As a result, samples were combined and SRB prediction equations were successfully developed for each of the measures. Conclusions: Establishing cross-validation for these SRB prediction equations provides initial support of their use to detect meaningful change in the ADNI sample, and provides the basis for future research with clinical samples to evaluate potential clinical utility. While some caution should be considered for measuring true cognitive change over time - particularly in clinical samples - when using these prediction equations given the relatively lower coefficients of stability observed, use of these SRBs reflects an improvement over current practice in ADNI.
  • Thumbnail Image
    Item
    Relationship of Hoarding and Depression Symptoms in Older Adults
    (Elsevier, 2024) Nutley, Sara; Nguyen, Binh K.; Mackin, R. Scott; Insel, Philip S.; Tosun, Duygu; Butters, Meryl; Aisen, Paul; Raman, Rema; Saykin, Andrew J.; Toga, Arthur W.; Jack, Clifford; Weiner, Michael W.; Nelson, Craig; Kassel, Michelle; Kryza-Lacombe, Maria; Eichenbaum, Joseph; Nosheny, Rachel L.; Mathews, Carol A.; Radiology and Imaging Sciences, School of Medicine
    Hoarding disorder (HD) is a debilitating neuropsychiatric condition that affects 2%-6% of the population and increases in incidence with age. Major depressive disorder (MDD) co-occurs with HD in approximately 50% of cases and leads to increased functional impairment and disability. However, only one study to date has examined the rate and trajectory of hoarding symptoms in older individuals with a lifetime history of MDD, including those with current active depression (late-life depression; LLD). We therefore sought to characterize this potentially distinct phenotype. We determined the incidence of HD in two separate cohorts of participants with LLD (n = 73) or lifetime history of MDD (n = 580) and examined the reliability and stability of hoarding symptoms using the Saving Inventory-Revised (SI-R) and Hoarding Rating Scale-Self Report (HRS), as well as the co-variance of hoarding and depression scores over time. HD was present in 12% to 33% of participants with MDD, with higher rates found in those with active depressive symptoms. Hoarding severity was stable across timepoints in both samples (all correlations >0.75), and fewer than 30% of participants in each sample experienced significant changes in severity between any two timepoints. Change in depression symptoms over time did not co-vary with change in hoarding symptoms. These findings indicate that hoarding is a more common comorbidity in LLD than previously suggested, and should be considered in screening and management of LLD. Future studies should further characterize the interaction of these conditions and their impact on outcomes, particularly functional impairment in this vulnerable population.
  • Thumbnail Image
    Item
    Reliable change in cognition over 1 week in community-dwelling older adults: a validation and extension study
    (Oxford University Press, 2021) Hammers, Dustin B.; Suhrie, Kayla R.; Dixon, Ava; Porter, Sariah; Duff, Kevin; Neurology, School of Medicine
    Objective: Reliable change methods can aid neuropsychologists in understanding if performance differences over time represent clinically meaningful change or reflect benefit from practice. The current study sought to externally validate the previously published standardized regression-based (SRB) prediction equations developed by Duff for commonly administered cognitive measures. Method: This study applied Duff's SRB prediction equations to an independent sample of community-dwelling participants with amnestic mild cognitive impairment (MCI) assessed twice over a 1-week period. A comparison of MCI subgroups (e.g., single v. multi domain) on the amount of change observed over 1 week was also examined. Results: Using pairwise t-tests, large and statistically significant improvements were observed on most measures across 1 week. However, the observed follow-up scores were consistently below expectation compared with predictions based on Duff's SRB algorithms. In individual analyses, a greater percentage of MCI participants showed smaller-than-expected practice effects based on normal distributions. In secondary analyses, smaller-than-expected practice effects were observed in participants with worse baseline memory impairment and a greater number of impaired cognitive domains, particularly for measures of executive functioning/speeded processing. Conclusions: These findings help to further support the validity of Duff's 1-week SRB prediction equations in MCI samples and extend previous research by showing incrementally smaller-than-expected benefit from practice for increasingly impaired amnestic MCI subtypes.
  • Thumbnail Image
    Item
    Validating 1-Year Reliable Change Methods
    (Oxford University Press, 2021) Hammers, Dustin B.; Porter, Sariah; Dixon, Ava; Suhrie, Kayla R.; Duff, Kevin; Neurology, School of Medicine
    Objective: reliable change methods can assist in the determination of whether observed changes in performance are meaningful. The current study sought to validate previously published 1-year standardized regression-based (SRB) equations for commonly administered neuropsychological measures that incorporated baseline performances, demographics, and 1-week practice effects. Method: Duff et al.'s SRB prediction equations were applied to an independent sample of 70 community-dwelling older adults with either normal cognition or mild cognitive impairment, assessed at baseline, at 1 week, and at 1 year. Results: minimal improvements or declines were seen between observed baseline and observed 1-year follow-up scores, or between observed 1-year and predicted 1-year scores, on most measures. Relatedly, a high degree of predictive accuracy was observed between observed 1-year and predicted 1-year scores across cognitive measures in this repeated battery. Conclusions: these results, which validate Duff et al.'s SRB equations, will permit clinicians and researchers to have more confidence when predicting cognitive performance on these measures over 1 year.
  • Thumbnail Image
    Item
    Validation of one-week reliable change methods in cognitively intact community-dwelling older adults
    (Taylor & Francis, 2021) Hammers, Dustin B.; Suhrie, Kayla R.; Dixon, Ava; Porter, Sariah; Duff, Kevin; Neurology, School of Medicine
    Reliable change methods can assist the determination of whether observed changes in performance are meaningful. The current study sought to validate previously published standardized regression-based (SRB) equations for commonly administered cognitive tests using a cognitively intact sample of older adults, and extend findings by including relevant demographic and test-related variables known to predict cognitive performance. Method: This study applied previously published SRB prediction equations to 107 cognitively intact older adults assessed twice over one week. Prediction equations were also updated by pooling the current validation sample with 93 cognitively intact participants from original development sample to create a combined development sample. Results: Significant improvements were seen between observed baseline and follow-up scores on most measures. However, few differences were seen between observed follow-up scores and those predicted from these SRB algorithms, and the level of practice effects observed based on these equations were consistent with expectations. When SRBs were re-calculated from this combined development sample, predicted follow-up scores were mostly comparable with these equations, but standard errors of the estimate were consistently smaller. Conclusions: These results help support the validity of of these SRB equations to predict cognitive performance on these measures when repeated administration is necessary over short intervals. Findings also highlight the utility of expanding SRB models when predicting follow-up performance serially to provide more accurate assessment of reliable change at the level of the individual. As short-term practice effects are shown to predict cognitive performance annually, they possess the potential to inform clinical decision-making about individuals along the Alzheimer's continuum.