Home Library Translate
A A A
Share »
Follow us on Facebook Follow us on Twitter Follow us on LinkedIn
Connect »

Blog: Nonprofit Capacity Building

Menu

  • This Blog's Home
  • Guest Writer Submissions
  • Policies
  • To Subscribe to a Blog
  • About
  • Feedback

Five Tips on Making Your Evaluation More Systematic

By Priya Small on May 11, 2013

Evaluation experts often define evaluation as a systematic endeavor.  Recently I have been considering what this really means.  How do we carry out a more systematic evaluation? How do we translate this into practice?

 

Aim for Consistency

Aim for consistency in data collection efforts.  Data should be collected the same way every time.  How can this be practically achieved?  Write out instructions for completing survey questionnaires and share them out loud.  Do this even though it might seem unnecessary. There are  various ways individuals can interpret how to answer a question.  For example, including the directions “please check off only one option” avoids potential problems such as some individuals only checking off the best response while others checking off multiple responses.

Also, use the same questions for the survey or semi-structured interview or focus group, each time.  This helps with consistency in data analysis across various groups.

 

Aim for Replicability

Include detailed instructions for those who will be administering your survey with the goal of someone else being able to replicate your evaluation study.  Though evaluation is not the same as research, aiming for replicability will make your evaluation efforts more consistent and systematic.  I like to think of it as akin to leaving detailed instructions for a friend who will be caring for a temperamental pet or plant.  Such a pet or a plant will thrive better on consistent care. So it is wise to attempt to replicate the same level of care you’d give the pet or plant by writing out a plan of care.

Sometimes stakeholders can feel that such instructions are insulting to their intelligence.  So it helps to emphasize the need for consistency and to explain why you are doing things the way you have chosen to do them.  Data that is collected inconsistently can result in difficulties in analyzing the data and having to exclude responses, which can further complicate analysis.    This also decreases the validity of the data collection method—that is, we are not really measuring what we think we are measuring.

 

Involve Stakeholders in Every Stage of the Evaluation, especially Planning

How do we maintain consistency especially when others are involved in data collection?  Involving key program stakeholders in planning the evaluation can increase consistency in data collection efforts.  Brainstorm with them ways to collect data consistently.  Provide an interactive training in data collection.

 

Draft a Written Plan for Data Collection

A written plan for data collection can help identify pitfalls ahead of time.  It also provides a game plan to stick to each time.  Once data collection has started, have regular meetings with program stakeholders or staff to discuss the data collection plan and how adherence to the plan can be maintained.

 

Pilot test Your Data Collection Method

Pilot testing your data collection method can help bring awareness of potential problems with your data collection tool.  It also provides a good opportunity for program stakeholders such as clients to provide input about your data collection method and tool.  A pilot testing survey includes questions such as:

  1. Were all the questions easy to understand?
  2. Were all the survey directions clear?
  3. Is there any other feedback you have about the survey process?
  4. How can we further improve this survey?
« Previous Next »

Search Our Site

Meet the Blog’s Co-Hosts

Marion is a popular facilitator of workshops and Board retreats. Her expertise includes strategic planning, board development, governance and harnessing the power of technology. [Read more ...]


Carter McNamara of Authenticity Consulting, LLC, provides organizational development, consultant training and Action Learning services, and is developer of the Free Management Library. [Read more ...]

Recent Blog Posts

  • The 2015 Wishlist of Books for Nonprofit Folk Is Here
  • Summer Reading for Nonprofit Folk
  • The Interim Between CEOs Is Important – Make the Most of It
  • Founders of Nonprofit Organizations
  • Nonprofits: Businesslike, But Not Businesses
  • The 2013 Millennial Impact Research Report – Focus on Benchmarks
  • How to Get out of the Evaluation Report Writing Slump
  • You and Your Nonprofit Board – New and Recommended
  • 2013 Nonprofit Finance Fund Survey Highlights
  • Tips on Planning for Focus Groups

Categories of Posts

  • Basics and Overviews
  • Boards
  • Collaborations
  • Evaluations
  • Finances
  • Fundraising
  • General Resources
  • Human Resources
  • Marketing
  • Programs
  • Social networking
  • Staffing
  • Strategic Planning
  • Technology
  • Uncategorized

Blogroll

  • two sets of questions

Related Library Topics

  • Assessments (Org'l)
  • Boards of Directors
  • Capacity Building
  • Consultants (Using)
  • Executive Dir. Role (CEO)
  • Group/Team Skills
  • Finances
  • Fundraising
  • Leadership
  • Management
  • Marketing
  • Program Management
  • Program Evaluation
  • Social Enterprise
  • Staffing
  • Succession Planning
  • Starting Nonprofits
  • Strategic Planning
  • Taxation
  • Volunteers

Library's Blogs

  • Boards of Directors
  • Building a Business
  • Business Communications
  • Business Ethics, Culture and Performance
  • Business Planning
  • Career Management
  • Coaching and Action Learning
  • Consulting and Organizational Development
  • Crisis Management
  • Customer Service
  • Facilitation
  • Free Management Library Blogs
  • Fundraising for Nonprofits
  • Human Resources
  • Leadership
  • Marketing and Social Media
  • Nonprofit Capacity Building
  • Project Management
  • Quality Management
  • Social Enterprise
  • Spirituality
  • Strategic Planning
  • Supervision
  • Team Building and Performance
  • Training and Development
About Feedback Legal Privacy Policy Contact Us
Free Management Library, © Copyright Authenticity Consulting, LLC ®; All rights reserved.
  • Graphics by Wylde Hare LLC
  • Website maintained by Caitlin Cahill

By continuing to use this site, you agree to our Privacy Policy.X