Summer End 2

 

5

Project 2 Program Evaluation Proposal: Project 2 involves designing a program evaluation for student’s  respective programs (i.e., Advocacy and Organizational Development; Educational Psychology, Applied  Research and Evaluation). The proposal should address the impacts of the program, its implementation or  both. The proposal should clearly delineate a feasible evaluation plan that draws on course readings, lectures,  exercises and presentations. The proposal is worth 25% of your total grade and should address all elements  described below.

Deliverable: Proposals should address elements detailed below. Proposals should be type-written, doubled spaced in 12pt font. Submit proposals by End of Day 30 July 2022 via CANVAS.

ELEMENTS OF THE PROPOSAL

The proposal shall include: (a) an introduction, (b) method, (c) proposed analysis, (d) discussion, and (e) a  reference page. Consult Mertens and Wilson (2019), and the APA Manual (2010) to address all elements of the  proposal. Brief descriptions for each section are provided below.

8. Introduction – Provide relevant background and focus for the evaluation proposal. What does the program seek to accomplish? Why is it important? What are the goals, objectives, and purposes of the program? What is the program’s “theory of cause and effect” (i.e., why and how will the program accomplish its goals, objectives and  purposes?). What question(s) does the evaluation seek to answer? Why are these questions selected? Is there  any literature that can inform the evaluation (reference it appropriately)? See Mertens and Wilson (2019)  Chapter 7-8.
9. Method. Design—Identify and describe the evaluation design. Explicate how the evaluation design relates to the goals, objectives, and purposes of the evaluation and comment on the appropriateness of the design to answer the evaluation objectives (e.g., Is the design appropriate to the evaluation goals, objectives and  purposes? Why did you select this design over other alternatives? What sources of potential invalidity are ruled  out with this design and what sources might remain?). Data and Measures—describe the data you propose to  collect for the evaluation (e.g., what types and quantity of data will be collected?) and comment on the  appropriateness of these data (e.g., What constructs will you focus on and how will you measure them? Are  these appropriate given the evaluation goals, objectives and purposes? What evidence of reliability and validity  can be provided for your measures?). Be sure to include example measures if available. Procedures–Describe  the context and logistics of the proposed data to be collected (e.g., what are the characteristics of the setting in  which data will be collected? What requirements in terms of personnel, space, equipment and means of  financing? What is the timeline for completing the evaluation? Do you anticipate any potential  problems/obstacles and how do you propose to deal with them?). See Mertens and Wilson (2019) Chapter 9-11.
10. Analyses and Findings. Analyses—Describe the analytical approach taken to evaluate the data and comment on the appropriateness of the analyses in relation to the evaluation goals, objectives and purposes (e.g. How do you plan to analyze the data and how will these analyses address the evaluation goals, objectives and purposes?  What specific analytical techniques will you use to address the evaluation goals, objectives and purposes [e.g.,  quantitative–ANOVA, Correlation, Regression; qualitative—content analyses]). Discuss strengths/weakness of  your proposed analytical approach. Findings—Describe the anticipated findings of the evaluation and  comment on how the findings relate to the evaluation goals, objectives and purposes (e.g., How will the  findings specifically address the evaluation goals, objectives and purposes or provide evidence to support, refute  or inform the program? What alternative interpretations may be ruled out by your proposed approach and what  plausible alternative or rival explanations can be made? Be sure to describe limitations or qualifiers of your  proposed approach?) See Mertens and Wilson (2019) Chapter 12.
11. References—You should list all references cited in the proposal in APA editorial style.

6

Project 2 Evaluation Form

Individual Project 2 Program Evaluation Proposal: Project 2 involves designing a program evaluation for student’s respective  programs (i.e., Advocacy and Organizational Development; Educational Psychology, Applied Research and Evaluation). The  proposal should address the impacts of the program, its implementation or both. The proposal should clearly delineate a feasible  evaluation plan that draws on course readings, lectures, exercises and presentations. The proposal is worth 25% of your grade.

Background & Focus (6 Points)	Not at  all   0	Partially 1.5	Completely 3	Total   Points
a. Does the narrative describe the background and context for the evaluation?
b. Does the narrative describe relevant aspects of the program (e.g., its  components, logic model or program theory) and its purpose (e.g, goals, objectives,  and evaluation questions)?
Evaluation Method (12 Points)	Not at  all   0	Partially 1.5	Completely 3	Total   Points
c. Does the narrative describe the data used to assess the evaluation objectives?  (e.g., types and amount of data collected and why?)
d. Does the narrative comment on the appropriateness of the data? (e.g., relevance  of data to goals, objectives and purposes, operationalization of constructs,  measurement qualities–reliability and validity)
e. Does the narrative describe the evaluation design and comment its  appropriateness for the evaluation (e.g., appropriateness of the design given the  goals, objectives and purposes; advantages and disadvantages of the design— threats to validity, alternative designs, pros and cons)
f. Does the narrative describe the context and logistics of the proposed data to be  collected (e.g., what is the setting for data collection and requirements in terms of  personnel, space, and equipment? What is the timeline data collection and for  completing the evaluation? Are there any anticipated obstacles/problems and how  do you propose to deal with them?)
Analysis and Findings (6 Points)	Not at  all   0	Partially 1.5	Completely 3	Total   Points
g. Does the narrative describe the analytical approach taken to evaluate the data  and comment on the appropriateness of the analyses (e.g. How will you analyze the  data and how will these analyses address the evaluation goals, objectives and  purposes? What specific analytical techniques will you use to address the  evaluation goals, objectives and purposes [e.g., quantitative–ANOVA, Correlation,  Regression; qualitative—content analyses]?)
h. Does the narrative describe anticipated findings of the evaluation and comment  on how findings relate to the evaluation goals, objectives and purposes? (e.g., How  will the findings specifically address the evaluation goals, objectives and purposes  or provide evidence to support, refute or inform the program? What alternative  interpretations may be ruled out by your proposed approach and what plausible  alternative or rival explanations can be made? Be sure to describe limitations or  qualifiers of your proposed approach?)
References (1 Point)	Not at  all   0	Partially 5	Completely 1	Total   Points
i. Are references cited in accordance with APA guidelines (e.g. author, year, title,  source and pages)?