PHE 630 Evaluation Methodology Worksheet

docx

School

Southern New Hampshire University *

*We aren’t endorsed by this school

Course

630

Subject

Information Systems

Date

Jan 9, 2024

Type

docx

Pages

Uploaded by alcatt

PHE 630 Evaluation Methodology Worksheet Instructions: Please refer to the Evaluation Work Plan within your draft grant proposal (Appendix D) as you complete the steps below. To complete this worksheet, replace the bracketed text with the relevant information and add in justification paragraphs where noted. 1: Refine your evaluation questions by evaluation type Use the tables below to refine/revise your process, outcome, and impact evaluation plans. Please note that the tables below do not contain all columns listed in Appendix D of your grant proposal template because the purpose here is to focus solely on the selection of evaluation methods and then explain how each method is an appropriate way to assess the data to see if the indicator is met. Upon revision of your evaluation plan, please feel free to update your grant proposal project accordingly. Process Evaluation Strategy ID Evaluation Question Indicators Data Sources/Instruments Methods EXAMPLE Did the stakeholders receive the education materials? Confirmation of mail received US postal service mail receipt and Excel spreadsheet listing each stakeholder When receive a mail receipt check off receipt of materials in Excel spreadsheet for given stakeholder and provide date materials received 1.A Will the length of study in suicide deterrence be beneficial? End of study test completed by the patient (post-test). Post Test Utilization of a spreadsheet to auto mark the completion of the post-test score once completed by the patient. 1.B Which intercession could be implemented in this program? Pre-test, Post-test, Surveys. Survey Once completed, they will be sorted and arranged from most to least beneficial. 2.A Once strategy has been modified and implemented, how will the effectiveness of health providers change? Hazardous behavioral aspects and surveillance systems (BRFSS) Records, Stakeholders, Organizational Members. Utilization of a database to collect and organize hazardous aspects of patients.

Strategy ID Evaluation Question Indicators Data Sources/Instruments Methods 2.B Are the educational program attempts efficient enough? Number of hours devoted to events, Opinions from volunteer teams, and activities achieved proportions. Timecards for both volunteers and staff members, response cards, Certificate of finalized module. Training of volunteers will be tracked using an excel spreadsheet to ensure completion of mandatory trainings. Upon their completion, a certificate will be issued. 3.A Is the outreach campaign within the community successful and effective? Amount of press releases, visitation logs, sign up sheet’s totals, and feedback from stakeholders. Press release receipts, visitation records, signup sheets, response cards. Receipts for press releases to be collected and monitored through the utilization of an excel spreadsheet for stakeholder review. 3.B Within directed communities, what is the concentration of resident assistance? Activities attendance and community participant responses. Online Reponses and response cards. Utilizing sites such as YELP or another website, feedback would be able to be recorded. The individual in charge of each specific meeting or event would be responsible for tracking the attendance utilizing a ring counter with data to be input into the excel spreadsheet. Justification for Process/Implementation Evaluation Methodology: The justification evaluation method is based upon the recordings of data insuring that it is all in the correct order and place. By utilizing precise recording techniques research will be able to be tracked and applicants who are participants within the research as well as those who live the research study will be documented. Modifications to this strategy will be used with the preparation proposal in order to ensure effectiveness it is required that constant record keeping for patients especially those with an elevated risk for suicide is documented. It is also imperative that all training documentation and records are Immaculate. The use of press releases will be able to assist within the community to ensure proper recognition is given to the program and its performance within its specific community.

Outcome Evaluation Strategy ID Evaluation Question Indicators Data Sources / Instruments Methods EXAMPLE Did stakeholder increase their understanding of student LGBTQ+ issues? Improved quiz score Pre and post quiz Compare pre and post quiz scores using a paired t-test 1.A According to the patients, which part of the study is the most useful? Feedback obtained and assessments made from post-tests Survey A T-Test could be used to compare the scores of surveys as well as post-tests. 1.B Did certain groups of individuals find this study to be more or less effective than others? Surveys, Pre and Post Tests. Survey, Pre/Post-tests. A T-Test could be used to compare the scores of surveys as well as post-tests. 2.A According to behavioral experts, which part of the program is most valuable? Individual 1-1 meetings. Monitor staff and documents. Meeting minutes (notes) and electronic record keeping. 2.B Were the trained skills utilized? Number of volunteers at events, crisis hotline use, and the training/attendance of volunteers. Timecards and Certificate of module completion. Excel spreadsheets will document completed trainings and hold certificates for those volunteers and the recording of timecards will be done with the Fuzion Web program. 3.A Has the community become more aware of the suicide rates? Meeting attendance and other organizational events. Visitation records. Visitor log will be documented using an excel spreadsheet. 3.B When building diversity within the communities, what is the concentration of supplies allocated? Public appearances, public hearings, organizational events, and other meetings. Visitation records. Visitor log will be documented using an excel spreadsheet and attendance records for meetings and events gathered with the use of a ring counter will also be documented there.

Your preview ends here

Eager to read complete document? Join bartleby learn and gain access to the full version

Access to all documents
Unlimited textbook solutions
24/7 expert homework help

J ustification for Outcome/Effectiveness Evaluation Methodology: The justification for outcome and effectiveness evaluation methods will utilize various techniques in order to compile complete evaluation results to ensure the most desirable outcomes. The utilization of the T test method to be able to evaluate the outcomes of the study is also a wonderful method to acquire information accumulated throughout the study as well as the creation of comparison from those tests obtained in the beginning of the study versus the end of the study. Another technique that could be used is to ensure the constant collection of data to ensure that it is all current as well as the patient’s chart being correct at all times this will allow the program to ensure that no patient is able to fall through the cracks. Impact Evaluation Strategy ID Evaluation Question Indicators Data Sources / Instruments Methods EXAMPLE Do students feel supported by their teachers? At least 75% of students report feeling supported Survey using 5 level likhert scale of strongly disagree to strongly agree Students complete survey during class and then compute percent who reported agree or strongly agree to feeling supported by their teachers, 1.A Are students feeling supported by those teaching them? Evaluation of both Pre/Post test results to be conducted to check their scores (Post-test greater than the pre- test). Evaluation of both Pre/Post test results. A T-Test could be used to compare the scores of surveys as well as pre and post-tests and then documented in an excel spreadsheet. 1.B Were the expected results produced? Record keeping of visitors to the program and events contained. Visitation records. Visitor log will be documented using an excel spreadsheet. 2.A What are the obstacles in regard to discrepancy among strategy implementations? Measurement values of the BRFSS System Monitorization of staff and organizational records. Meeting minutes (notes) and electronic record keeping.

Strategy ID Evaluation Question Indicators Data Sources / Instruments Methods 2.B How effectively were the trainings implemented? Attendance of volunteers and their trainings. Certificate of module completion and timecards. Excel spreadsheets will document completed trainings and hold certificates for those volunteers and the recording of timecards will be done with the Fuzion Web program. 3.A Has there been an increase in the perception of suicide deterrence within the community? Occurrences that patients use the suicide deterrence program and assistance of others within the community. Visitation records and new volunteer sign up. Visitor log will be documented using an excel spreadsheet and new volunteer sign-ups will also be documented there. 3.B Was the best potential use of assets utilized for the suicide deterrence program? Community presence (conferences, events, promotions, etc.) and a diversified group of volunteers. Visitation records and substantial volunteer groups. Visitor log will be documented using an excel spreadsheet and attendance records for meetings and events gathered with the use of a ring counter will also be documented there. Justification for Impact Evaluation Methodology: Utilizing the T test for comparison during the study is the technique that we'll use in order to obtain a definite outcome of all of the information that has been compiled throughout. This will allow for a comparison to be created from the beginning to the end of the study. By utilizing a checking approach common data will be able to be kept current and we will be able to confirm that a patient's chart is 100% accurate. If monitoring was to decline in any way, then there would be many obstacles to overcome. Ensuring that data of those utilizing the visitors log is being maintained as well as all of the individuals that have used the logbook will be able to reveal an alibi and account for all individuals who have attended community events and conferences. 2: Determine the formative evaluation methods In Appendix D of the grant proposal template, you were not required to add any formative evaluation questions (and related methodology). At this time, please construct an impact evaluation plan using the table below. You are encouraged to add this information on impact evaluation methodologies to Appendix D by adding a new row to each table and using the code “F” for the first column. Formative Evaluation

Strategy ID Evaluation Questions Indicators Data Sources / Instruments Methods EXAMPLE Is there a lack of support or understanding of LGBTQ+ students in the school? Issues/concerns have been raised by multiple people Qualitative data from Focus Groups Conduct focus groups of teachers, students and staff regarding issues around LGBTQ+ understanding and support. Analyze data for themes. 1.A Could proposals from stakeholders and participants aid in the refining of program efficacy? Problems and concerns regarding applicants within the study Qualitative data gathered from treatment groups, record of those individuals who have left the group. Therapy groups will be conducted for support of patients and the information obtained will be evaluated using BRFSS and checklists. 1.B How is the efficacy of the program ranked by stakeholders? Compliments or concerns raised by multiple individuals. Feedback Catalogue. Catalogue available of program website, YELP, and other review sites. 2.A Which part of the program do participants find most helpful? Surveys & Reviews Feedback Catalogue. Catalogue available of program website, YELP, and other review sites. 2.B How can becoming a volunteer support the program and its participants? Ensure volunteers are up to date on all trainings Quality Training. Spreadsheet within excel will organize and contain all volunteer training data and certificates. 3.A Can the stakeholders and community offer feedback to improve the significance, efficacy, and value of the program within the community? Compliments or concerns raised by multiple individuals. Feedback Catalogue. Catalogue available of program website, YELP, and other review sites.

Your preview ends here

Eager to read complete document? Join bartleby learn and gain access to the full version

Access to all documents
Unlimited textbook solutions
24/7 expert homework help

Strategy ID Evaluation Questions Indicators Data Sources / Instruments Methods 3.B Can stakeholders evaluate and rank the significance of staff members/volunteers regarding the community image? Problems and concerns that are expressed by staff and stakeholders regarding volunteer employment procedures. Feedback Catalogue. A hiring committee will ensure the staff and volunteers are comprised of diversity. Justification for Formative Evaluation Methodology: The formative evaluation methods are able to produce an assessment which is constructive ensuring that all possible information would be able to be accumulated. Track and research records from notes obtained during therapy sessions as well as utilization of the BRFSS analysis performance specifications. Ensuring that encouraging evaluations are continually being obtained will be able to assist in the development of confidence within the community to help approved the program successes. Lastly, stakeholders will be able to make suggestions to aid in the development to ensure the program has a trusting image. 3: Summarize what each Evaluation type will inform you about your program – what useful information will it provide to improve your program? Each evaluation type we'll track a different part of this process within the program to ensure that all information and necessary data is in place. The use of precise record keeping will ensure that research is able to be tracked and that applicants that are participating in the research are able to be successfully assisted. For strategy modifications to be properly employed during the preparation proposal to ensure effectiveness will require consistent record keeping for patients who are at an elevated risk of suicide and training completion must be documented. Press releases will allow the community to recognize the program and to see exactly how much good the program is able to do within the community itself. By utilizing various techniques, a definite evaluation result is the best way to demonstrate any and all outcomes. By utilizing the T test method, study outcomes will be able to be compared with information accumulated from the initial start of the study until the end. To ensure that no individual is able to fall through the cracks within the healthcare system, a subsequent technique of checking is essential to ensure data is kept as current as possible and that the patient's chart is always 100% accurate. If there were to be a decline in monitoring, there would be many obstacles to overcome. Ensuring that the visitor's log is properly maintained will assist in the accountability of the program and its support staff. An e-mail list will also need to be kept current at all times. Lastly, by ensuring the maintenance of the data of those individuals who are not utilizing the visitors log, as well as individuals that have used the log, we will be able to properly account for all individuals who have attended conferences within the community as well as community events.

References: American Foundation for Suicide Prevention. (2021). Suicide statistics. Retrieved. https://afsp.org/suicide-statistics American Foundation for Suicide Prevention. (2021). Financials: Not for profit status. Retrieved. https://afsp.org/financials American Foundation for Suicide Prevention. (2021). About. Retrieved. https://afsp.org/about-afsp American Foundation for Suicide Prevention. (2021). Three-year strategic plan 2019-2022. Retrieved. https://www.datocms - assets.com/12810/1578573723-13961afspstrategicpland11.pdf American Foundation for Suicide Prevention. (2021). Supporting diverse communities. Retrieved. https://afsp.org/supporting-diverse-communities Center for Disease Control and Prevention. (2021). Risk and protective factors: Many factors contribute to suicide risk. Retrieved. https://www.cdc.gov/suicide/factors/index.html Center for Disease Control and Prevention. (2021). Fast facts: Suicide is a large and growing public health problem. Retrieved. https://www.cdc.gov/suicide/facts/index.html Congress.Gov. (2021). H.R. 5619- Suicide act. 116 th Congress (2019-2020). Retrieved. https://www.congress.gov/bill/116th-congress/house - bill/5619 National Institute of Mental Health. (2021). Suicide prevention. Retrieved. https://www.nimh.nih.gov/health/topics/suicide-prevention/#part_149720 National Institute of Mental Health. (2021). Frequently asked questions about suicide. Retrieved. https://www.nimh.nih.gov/health/publications/suicide-faq/

Suicide Awareness Voices of Education. (2021). Suicide facts: General statistics (USA). Retrieved. https://save.org/about-suicide/suicide-facts/

Your preview ends here

Eager to read complete document? Join bartleby learn and gain access to the full version

Access to all documents
Unlimited textbook solutions
24/7 expert homework help

PHE 630 Evaluation Methodology Worksheet

Related Documents