Skills on Wheels: Program evaluation and modifications to increase the reliability and validity of the Wheelchair Skills Test

Abstract

The Skills on Wheels pediatric wheelchair training program lacks program protocols that support the reliability and validity of assessment administration while also showing a lack of skill retention at one-year follow-up which demonstrates the need for program evaluation and modification to support accurate data collection and scoring to draw conclusions from. This is important as this population faces many barriers including insufficient wheelchair skills training when receiving a wheelchair therefore making it difficult to navigate in the community and with others. This can have a great impact on them and the Skills on Wheels program aims to address these gaps to ensure equal and fair participation in daily activities. Therefore it is important that the skills taught during programming are retained and have a long term impact. The purpose of this capstone will be to evaluate and improve the overall functioning and protocols for current programming to increase the accuracy of assessment administration and scoring thus aiming to address potential discrepancies in data from which conclusions are drawn about skill retention issues. The capstone student developed and implemented an in-depth training regarding the Wheelchair Skills Test and evidence based skill training interventions. The capstone student also developed and implemented a protocol for the Wheelchair Skills Test administration to decrease biases and increase inter-rater reliability through a consistent group of trained individuals who are blinded to the subjects skill ability. Results found that volunteers felt both more prepared and accurate in their scoring than in years past and their confidence increased. Additionally, the scoring results from 2024 showed a more realistic skill range and increase among participants than years past supporting higher accuracy. Skills on Wheels would benefit from continuing to utilize protocols and training developed during this capstone experience to continue to enhance the reliability and validity of the program and support accuracy in data findings. This capstone began a process of program evaluation to continue to identify areas that impact the skills training the participants receive and the scoring of the assessment that determines outcomes of the program and participants.