-
-
-
-
-
-
-
Performance Measurement Learning Collaborative
-
-
-
-
-
-
-
-
-
Performance Measurement Learning Collaborative
The purpose of the learning collaborative is to provide a platform for the exchange of ideas related to performance measurement. The collaborative meets at least quarterly to discuss topics related to planning, implementing, and reporting on the outcomes of Lifespan Respite grant activities. Based on the interest and proprieties of the group, guest speakers may join to share their expertise on topics such as: identifying and accessing data sources, practical strategies for tracking progress on goals and objectives and methods, and best practices for reporting on data to stakeholders.
The collaborative explores ways to measure performance related to the stated purposes of the Lifespan Respite Care Program; specifically, strategies for measuring the degree to which programs expand and enhance respite care services to family members; improve statewide dissemination and coordination of respite care; and provide, supplement, or improve access and quality of respite care services to family caregivers. The collaborative will identify and seek solutions to challenges of measuring system’s change outcomes as well as the outcomes of caregivers and their families.
You are welcome to join the collaborative whether you have a well-established system for measuring and reporting on your performance targets, are just starting to plan a performance measurement strategy, or are somewhere in-between.
For more information, please contact Casandra Firman with ARCH.
Meetings
December 15, 2022
Tami Cirerol, Asst Director of the Center for the Study of Aging, and Sarah E. Toevs, Director of the Center for the Study of Aging at Boise State University, and Hanna Scheuffele, with the ID Caregiver Alliance, shared information on the evaluation tool(s) they’ve used for Idaho’s Lifespan Respite initiatives, including their respite voucher pilot program. PPT Presentation
Daniel J Koltz, PhD, Assistant Professor at Montana State University, MT Caregiver Respite Retreat Program Director, MT Kinship Navigator Program Director, and a partner in the MT Lifespan Respite grant, presented on the World Health Organization's Five Well-Being Index (WHO-5), a measurement tool that he uses in a caregiver respite retreat program that he discussed at the Lifespan Respite Grantee and Partner Learning Symposium in Madison in September. WHO-5 Questionnaire
Casandra Firman, ARCH Performance Measurement Learning Collaborative facilitator, also demonstrated how to calculate statistical significance using Excel, including a quick-and-dirty primer on how to use excel to perform a t-test. She discussed why statistical significance is important, and what it does and does not tell us about data. PPT Presentation.
Zoom Recording
September 8, 2022
Two members of the collaborative, Nick Slentz, Virginia Department for Aging and Rehabilitative Services, and Cory Lutz, Helping Hands of Vegas Valley, Nevada, shared the tools they use for measuring outcomes, discussed how they use the tools, and how the tools have helped them better understand their services. Casandra Firman, ARCH, also shared tools developed by ARCH for measuring the outcomes of both planned and crisis respite programs.
Resources
VA Voucher Respite Measurement Survey Tools
NV Helping Hands of Vegas Valley Voucher Survey ToolsARCH Planned Respite Evaluation Tool
ARCH Crisis Respite Evaluation Tool
Zoom Recording
June 23, 2022
ACL Data Elements for Lifespan Respite Program Grants
The Administration on Community Living is developing a performance measurement standard for the Lifespan Respite Program that will be submitted to OPM in the coming months for final approval, and published in the Federal Register for a public comment period. The goal is to eventually implement a required reporting tool for Lifespan Respite grantees. Heather Menne, Senior Health Policy Researcher with RTI, has been working with ACL to identify data elements that grantees may be required to collect in future years. During this meeting, she and Lori Stalbaum from ACL shared the current draft of the tool and discussed the proposed data elements with Learning Collaborative participants to gather their feedback.
The recording of this meeting and the draft tool are not available to the public on this website. If you are a Lifespan Respite grantee or a primary partner interested in seeing the data tool, please contact ARCH and we will send you the information.
March 17, 2022
Presentation
A Conversation with Dr. Rebecca Utz, Respite Researcher and Professor of Sociology, University of Utah. Read more about Dr. Utz and her research.
Dr. Utz showed us behind the scenes of her research, discussing how she identifies evaluation questions and measures, how data are gathered and analyzed, and how family caregivers and care-providers participate in the work. Learn about her current research, Time for Living & Caring (TLC) here. She currently has funding from the National Institute on Aging to study the effectiveness of an intervention (app) that helps family caregivers plan for and make better use of their respite care time. Learn more about this research in her presentation last year at the ARCH Respite Research Summit.
Dr. Utz was also interested in learning from us. We shared the questions we have, as providers and family caregivers, that we want answered through research. We also discussed common data elements important for understanding the impact of respite on family caregivers.
Resources
Standardized scales related to health
Time for Living & Caring (TLC)
Flyer used to recruit family caregiver study participants
Background on the importance of family caregivers’ use of their respite time on caregiver outcomes can be found in an early ARCH webinar on Making Respite More Effective, with a colleague of Dr. Utz, Dr. Dale Lund.
Zoom Recording
December 16, 2021
(Kim Whitmore was unable to present. Her presentation on tearless logic models will be rescheduled at a later date).
Presentation
Working with an External Evaluator: Moving from a logic model to a full report
Shared by Doris Green, New York State Caregiving and Respite Coalition, and Deana Prest, New York State Office for the Aging. Doris and Deana described how they partnered with an external evaluator to create and implement an evaluation plan. They will talk about the participatory approach they followed with the evaluator and share the formal report documenting evaluation results.
Lifespan Respite Care Program: Advancing State Lifespan Respite Systems - New York, Program Evaluation Report, December 2021New York State Lifespan Respite Program - Program Evaluation Plan, 2015
Expanding a Volunteer Respite Workforce to Provide Support to Caregivers in New York State, Presentation by Thomas V. Caprio, MD, MPH, MS, CMD, HMDC, FACP, AGSF, FAAHPM, ARCH Respite Research Summit, September 2020.
Additional Shared Resources
Outcomes and Indicators Logic Model from FRIENDS NRC
Compendium of Annotated Measurement Tools
National Validated Measurement Tools
Zoom Recording
September 30, 2021
Zoom Recording
June 3, 2021
ARCH Presentation on Outcomes vs Outputs, PPT Slides
Measuring Collaboration in Lifespan Respite: Massachusetts Levels of Organizational Integration, Presentation of Leanne Winchester, MA Lifespan Respite Coalition, PPT Slides
Zoom Recording
March 4, 2021
Presentations and Resources
ARCH Presentation, PPT Slides
Idaho Presentation
Logic Model for the Family Caregiver Navigation (FCN) Pilot Program
CareBreak Evaluation Tools
Alabama Respite
Alabama Whitepaper - A VOICE THAT MATTERS The Impact of Family Caregiving in Alabama
Zoom Recording
December 10, 2020
Documents for Discussion
Zoom Recording