McGrew, John H.Stull, Laura G.Rollins, Angela L.Salyers, Michelle P.Hicks, Lia J.2014-03-122014-03-122011-06McGrew, J. H., Stull, L. G., Rollins, A. L., Salyers, M. P., & Hicks, L. J. (2011). A comparison of phone-based and on-site assessment of fidelity for assertive community treatment in Indiana. Psychiatric Services, 62(6), 670-674.https://hdl.handle.net/1805/4093Objective: This study investigated the reliability and validity of a phone-administered fidelity assessment instrument based on the Dartmouth Assertive Community Treatment Scale (DACTS). Methods: An experienced rater paired with a research assistant without fidelity assessment experience or a consultant familiar with the treatment site conducted phone-based assessments of 23 teams providing assertive community treatment in Indiana. Using the DACTS, consultants conducted on-site evaluations of the programs. Results: The pairs of phone raters revealed high levels of consistency [intraclass correlation coefficient (ICC)=.92] and consensus (mean absolute difference of .07). Phone and on-site assessment showed strong agreement (ICC=.87) and consensus (mean absolute difference of .07) and agreed within .1 scale point, or 2% of the scoring range, for 83% of sites and within .15 scale point for 91% of sites. Results were unaffected by the expertise level of the rater. Conclusions: Phone-based assessment could help agencies monitor faithful implementation of evidence-based practices. (Psychiatric Services 62:670–674, 2011)en-USPhone-based fidelity assessmentassertive community treatmentArticle