Program Evaluator

The Salvation Army is an international Christian church. Its message is based on the Bible; its ministry is motivated by love for God and the needs of humanity.
Mission Statement The Salvation Army exists to share the love of Jesus Christ, meet human needs and be a transforming influence in the communities of our world.
Core Values The Salvation Army Canada and Bermuda has four core values:
Hope: We give hope through the power of the gospel of Jesus Christ.
Service: We reach out to support others without discrimination.
Dignity: We respect and value each other, recognizing everyone’s worth.
Stewardship: We responsibly manage the resources entrusted to us.

Reporting to the Territorial Social Services Secretary, the Program Evaluator is responsible for measurement of mission outcomes.  This will include coordinating and overseeing program evaluations for the organization in order to promote internal and external accountability and inform resource allocation decision making.  The Program Evaluator will engage with stakeholders at various levels of the organization (local, divisional, territorial), supporting them in measuring the outcomes of  mission-driven programming in corps and social services.  This will include the formulation of an evaluation strategy for the territory, the development of program assessment tools and the implementation of program evaluations.  The position is vital in ensuring that quality improvement continues for the benefit of the people we serve and the communities where we serve, and that we are being the best stewards of what is being entrusted to us.

Accountabilities:

Evaluation Strategy and Plans:

• Collaborate with other Salvation Army personnel to develop standards for TSA program evaluation in corps and social services.
• Formulate an evaluation strategy for the territory for social services and corps and develop plans for its implementation in collaboration with internal stakeholders
• As required, collaborate and provide assistance to the Ministry Units in developing evaluation plans in response to RFPs (goals, evaluation methods, etc.)
• Outline performance indicators, outcome measurement frameworks, and feedback mechanisms for mission effectiveness
• Apply evaluation tools and methodologies, drawing on a range of qualitative and quantitative approaches to develop surveys, interview and discussion guides, and other data gathering tools

Professional Practice:

• Support stakeholders in evaluating mission impact directed at increasing the capacity of The Salvation Army to provide exemplary ministry, healthy corps and social services, and maximized mission outcomes
• Participate in planning and coordinating conferences, workshops and national events
• Represent The Salvation Army at conferences and workshops

Data Collection, Analysis, and Reporting

• Explore and implement ways to meaningfully engage people with lived experience in evaluation and planning at all levels of the organization
• Work with Statistician and other stakeholders to ensure statistics being collected are useable and contain outcomes-oriented data
• Collaborate with program staff and management in the planning and evaluation of programs
• Prepare evaluation reports for The Salvation Army and external organizations
• Collect, analyze and disseminate literature pertaining to program evaluation
• Consult on day to day evaluation and applied research problems
• Plan, implement and participate in data collection activities including administration of surveys, interviews, focus groups and other methods
• Provide assistance in the development of quantitative and qualitative data analysis strategies
• Provide assistance in the interpretation of quantitative and qualitative results and in the presentation of results
• Participate in meetings and prepare necessary materials when required

Documentation, Standards and Continuous Improvement:

• Maintain current knowledge of best/promising practices and monitor changing response/new approaches to service provision
• Develop documents (e.g. tools, reports, reviews, standards, sample policies, guidelines, FAQs, etc.) for Salvation Army programs and personnel on relevant issues
• Maintain membership in relevant associations
• Record, manage and preserve data in a safe and accessible way

Knowledge Mobilization

• Communicate with stakeholders to keep them informed of evaluation activities
• Maintain effective consultative and collaborative relationships with internal and external stakeholders
• Distill research findings into plain language documents that are easily accessible to a non-academic audience
• Prepare content for publication, including researching, writing, editing, reports, toolkits, case studies, executive summaries, policy and media relations documents, etc.
• Build capacity for ministry units to do their own program evaluation through training and the provision of tools

Education, Qualifications and Certifications:  

• Graduate degree in Health or Social Service Administration, Social Work, Humanities, or other relevant combination of education and experience
• Undergraduate and/or graduate courses in program evaluation
• Credentialed Evaluator designation is an asset

Experience and Skilled Knowledge Requirements  

• Minimum 5 years of experience in relevant roles (i.e., in a program evaluation-related position in a community/policy setting)
• In depth knowledge and experience with program evaluation and performance measurement
• Experience with data collection (e.g., survey creation and administration, key informant interviews, focus groups, etc.)
• Experience in evaluation methodologies
• Experience in creating outcomes monitoring frameworks
• Knowledge in community-based nonprofit sector evaluation methods
• Knowledge of evaluation theory and practice
• Excellent organizational, planning, coordination and analytical skills
• Demonstrated ability to review and synthesize information
• Considerable experience in preparing well written reports on complex evaluation projects and effectively presenting on them
• Familiar with the creation of theories of change, logic models, evaluation plans, program improvement plans, and evaluation reports
• Experience in the development of performance measures and identifying performance indicators and knowledge of appropriate evaluation instruments and techniques to properly conduct evaluations
• Experience with evaluability assessments and process and outcome evaluations, including the use of both qualitative and quantitative methodologies

Skills and Capabilities:  

• Demonstrated ability to establish and maintain effective working relationships with all levels of staff, public and community agencies
• Ability to prepare and present education material
• Ability to deal with others effectively within a team setting and to use judgment and diplomacy
• Demonstrated ability to plan, set, organize and accomplish objectives
• Computer literacy with word processing, data analysis software, PowerPoint, spreadsheets (Excel) and web-based applications and database skills
• Physical ability to perform the duties of the position
• A critical thinker with advanced capacity for analysis and synthesis
• Ability to work independently and as part of a team
• Strong problem solving skills
• Relationship management and influencing skills
• Fluency in English; French an asset
• Good analytical skills
• Ability to prioritize, multi-task and meet deadlines in a fast paced environment
• Ability to handle confidential information
• Strong customer service orientation
• Superior attention to detail
• Able to establish credibility quickly within the organization as a trusted advisor
• Able to work in a consultative, diplomatic and tactful manner
• Strong sense of integrity with professional ethics and a balanced sense of fairness and flexibility
• Seeks common ground in navigating challenging issues and constructively manages conflict to create win-win solutions wherever possible
• Able to proactively recognize potential risks and issues, respond with solutions and engage others in implementing change
• Strong written and verbal communication skills – clear and simple to understand
• Effective organizational and time management skills – self-motivated and disciplined self-starter
• Possesses both operational and strategic business acumen
• Respect and understanding of The Salvation Army – its mission, culture, and values