Evaluation Guidelines
The following list provides a summary of the key components and ideas that should be part of your evaluation planning and your discussions with your evaluator.
Conduct process evaluation
Procecss evaluation answers the question, “Is the program being implemented as planned?” This may include regular site visits of the program in action to observe and talk with staff and youth. It may also include tracking the number of youth enrolled and descriptions of activities delivered by staff. You may also want to ask for feedback from stakeholders (participants, staff, parents, teachers, principal, etc.) about the program. This is most useful if you don't wait until the program is over! NIYLP has created a Session Evaluation form which you might want to adapt.
Conduct outcome evaluation
Outcome evaluation answers the question, “How have participants changed as a result of the program?” This almost always includes collecting information at regular intervals about participants. You might administer a paper and pencil survey at the beginnning and end of the program to see how participants have changed their attitudes, skills, knowledge, and behavior. You might also conduct interviews with individual or small groups of youth participants at the beginning and end of the program year. NIYLP can suggest a variety of survey and other instruments to support your outcome evaluation.
Provide feedback to staff / continuous improvement
Use data to improve program efforts. Share good news, as well as areas in need of improvement.
Provide feedback to other stakeholders
Send regular reports (oral and/or written) to funding agencies, schools, community agencies, parents and youth to ensure their continued support and interest. Brag about achievements. Enlist their help where needed.
Involve staff in data collection & analysis
Present data in relatively “raw” form and ask staff and other stakeholders what it means.
Evaluation activities are ongoing (don’t conduct an autopsy!)
Your evaluator should attend regular staff meetings, conduct participant observations and informal interviews, set up a listserv, etc.
The Evaluator should see herself as a member of the program team (independent, but connected)
The evaluator works for the program, not the funding agency. She should let program staff know when and what she’s communicating to the funding agency and others.