Evaluation/Program Assessment

What does it mean to move beyond volunteers as a “program” and, instead, embrace engagement as a strategy to fulfill your mission? The shift starts by understanding the benefits of developing a strategic plan for volunteer engagement. In this article, writer Beth Steinhorn highlights some of the research behind volunteer engagement strategies and shares a step-by-step process for developing a volunteer engagement strategic plan. She traces how one regional humane society developed such a plan and, as a result, is now lightening its staff’s heavy workload, bringing more skills into the organization, gaining more advocates, increasing resources, and ultimately helping more animals. 

 

In this quarter’s Research to Practice, Laurie Mook reviews a study by Mark A. Hager and Jeffrey L. Brudney testing whether or not the “adoption of ‘best practices’ (such as interviewing volunteers, matching them to assignments, supervising volunteer activities, and recognizing their contributions to organizations) are associated with program outcomes of recruitment ease, retention of volunteers, and the net benefits that volunteers bring to organizational operations” (2015, 235). The data arise from telephone interviews with volunteer administrators or executive directors in a nationally representative survey of 1,361 organizations in the U.S. Their findings may cause you to rethink (or reinforce!) your approach to volunteer management.

This quarter’s Research to Practice reviews an article that presents a way to measure the social returns on investment in volunteer recruiting, training, and management. Called Social Return on Investment, or SROI, it is a type of cost-benefit analysis that compares the present value of social outcomes created by the organization to the value of monetary and in-kind resources (including volunteer contributions) required to generate those outcomes.

As reviewer Laurie Mook explains, funders and government agencies have expressed great interest in the idea of calculating SROIs for organizations. Mook looks specifically at a case study by Italian researchers who apply this process to the volunteer program of a summer camp that offers recreational therapy for children with serious illnesses. The researchers end up with a SROI calculated as a ratio between the total present value of impacts on volunteers as well as on services, and the total costs of inputs required to recruit, train, and manage volunteers. Mook also examines the methodology as a potential tool to focus attention on the socio-economic impact created by organizations, for volunteers themselves, and for society-at-large. 

Andrew G. Haldane, Chief Economist, Bank of England, recently stated that “whether seen from an economic or social perspective, volunteering is big business, with annual turnover well into three-figure billions.” And in his recent lecture to the Society of Business Economists in London, Haldane also pointed out that volunteering “is a well-hidden jewel, whose social worth is rarely the subject of a public valuation.”

In this special feature, e-Volunteerism presents an edited excerpt of Haldane’s lecture, which provides what Haldane describes as “a valuation, however imperfect” to help understand the social value of volunteering and exactly why this economist thinks it is so important. “If the value of volunteering remains largely out of sight, it is likely also to remain out of mind,” Haldane predicted. “The potential economic and societal benefits from volunteering then risk remaining un-tapped. Yet with a nudge, that volunteer army could swell further.”

Because Haldane is an internationally recognized economist, his presentation carries considerable influence and importance for the volunteer community. Haldane’s lecture includes a description of the fascinating volunteer service called Pro Bono Economics that he helped establish in the UK, which will be of great interest to all e-Volunteerism readers. 

 

The ability to measure the processes and outcomes of organizational initiatives is vital to understanding whether an organization has achieved its mandate. But determining the best method to measure the impact of volunteers and how to successfully report on those findings are distinct challenges in volunteer administration.

In this excerpt from a new, yet-to-be-published book called Measuring the Impact of Volunteers: A Balanced and Strategic Approach, authors Christine Burych, Alison Caird, Joanne Fine Schwebel, Michael Fliess, and Heather Hardie review the limits of statistical reporting and suggest ways to measure and communicate more useful data once it is collected. Using examples and outlining strategies, the authors present the basic touchstones of reporting results and note that it’s important to consider your audience, how and who should deliver the reports, and what to do if the news is not good. 

“Utilizing the strategies we have outlined for reporting on the engagement of volunteers can play an important role in articulating the impact and contribution of volunteers,” the authors write. “Reporting in a strategic way helps us to focus our priorities and to communicate to volunteers, key stakeholders, our executives, and boards that we are achieving our mandate to support the mission and vision of our organizations.”

This quarter’s Research to Practice contributes to the theme of Volunteer Centers. Reviewer Laurie Mook looks at a study of the direct and secondary impacts of the HandsOn Network and its affiliated member organizations: Measuring the Impact of HandsOn Network: An Evaluation of Direct and Secondary Impact from the Stakeholder Perspective.

Based in Atlanta, GA, HandsOn calls itself “the largest network of local volunteer centers around the world,” with 250 affiliates. Whereas previous studies relied on self-reports from affiliates to provide evidence of their impact, the researchers in this study used surveys and interviews to collect data directly from affiliates, community partners, and volunteers. Based on the perspectives of these groups, the researchers developed a conceptual framework that other Volunteer Centers and other intermediaries can use to measure the impact of their work.  

 

The Volunteer Program Assessment (VPA) provides consulting services to nonprofit volunteer programs across the United States and Canada. VPA consultants are graduate students and faculty from five universities who volunteer their time to work one-on-one with leaders of volunteers. VPA was established with the help of funding from The Humane Society of the United States (HSUS), which continues to provide financial support for volunteer programs – within the animal welfare sector and beyond – to receive VPA at no cost. Currently, VPA is seeking to expand its outreach efforts and diversify its nonprofit client base.

In this e-Volunteerism feature, four authors from the University of North Carolina at Charlotte provide a brief history of VPA, an overview of the process, and a summary of its success to date. Based on normative data from over 100 nonprofits, the authors describe three common areas for improvement among volunteer programs. They also provide additional information for those interested in participating in VPA.

In the last quarter century, nonprofits have increasingly been held accountable for the resources that have been entrusted to them. For some organizations, accountability mechanisms have been imposed left, right, and center, as funders and donors seek to monitor the use of the funds they provide. While a reasonable amount of accountability is beneficial all around, too much emphasis on this measure can be stifling and may indeed have exactly the opposite effect of what it intended to promote: efficient and effective use of resources.

While we generally can find information on the financial resources used by nonprofits, public disclosure of the amount and significance of volunteer contributions to those organizations is far less common. In this Research to Practice, Laurie Mook presents the findings of researchers in Australia who set out to determine just how organizations account for volunteer services. The study involved over 400 nonprofit organizations. The researchers systematically reviewed these organizations’ websites and annual reports for any disclosure of volunteer contributions, including their acknowledgement; how they supported mission and the wider community; human resources measures such as the number of volunteers and hours contributed; and policies guiding their involvement.

How well did the organizations do in discharging their accountability for their reliance on and use of volunteer contributions? Too much, too little or just right? As Mook reveals, the results are enlightening.