feedback seth:   Outcome Being Evaluated: One... | Psychology

Research Requirement:

Outcome Being Evaluated: One intermediate outcome for Tides Family Services is improved family functioning among youth participants following engagement in strength-based counseling and cognitive behavioral therapy services. This outcome is defined as measurable progress in family relationships, communication, and resilience, as indicated by standardized family functioning assessment tools administered pre- and post-intervention. More specifically, measuring the Tides "Outreach and Tracking" program and whether there is improved linkage to community support resources for youth and families at the time of program discharge. This outcome is operationalized as the proportion of families who, upon closing services, are actively connected to at least one community-based support resource (e.g., mental health services, educational programs, or social services) that addresses their identified needs. Evaluation Design: The best way to evaluate this outcome is by using a self-controlled pre-/post-design. This method compares each participant's connection to community support resources at both intake and discharge. It’s a logical choice because it allows the researchers to observe how each family changes over time, without needing to set up a control group or other program components that aren't actually in place (Pre-Post Study: Definition, Advantages, and Drawbacks, n.d.). Additionally, Tides Family Services already gathers data on family needs and service connections during intake and discharge, so this approach is practical and aligns with our current processes. Limitations of the Design: A key limitation of the self-controlled pre/post design is "history effects", the possibility that changes in linkage to community resources may be influenced by external events or changes in the community environment (such as new resource availability or policy changes) rather than the program itself (Miller et al., 2020). For example, if a new community mental health clinic opens during the program period, families may be more likely to connect to services regardless of their participation in the Outreach and Tracking program. This makes it difficult to attribute improvements solely to the intervention (Bykov et al., 2019). Sampling Strategy: The evaluation will include all families who participate in the Outreach and Tracking program and complete both intake and discharge assessments. This approach ensures that the sample reflects the actual population served by the program and allows for the assessment of change over time for each family. This sampling strategy is appropriate because it aligns with the program’s real-world implementation and captures the diversity of families served, including those with varying levels of risk and need. References Bykov, K., Franklin, J. M., Li, H., & Gagne, J. J. (2019). Comparison of Self-controlled Designs for Evaluating Outcomes of Drug–Drug Interactions. Epidemiology, 30(6), 861–866. https://doi.org/10.1097/ede.0000000000001087 ‌ Miller, C. J., Smith, S. N., & Pugatch, M. (2020). Experimental and quasi-experimental designs in implementation research. Psychiatry Research, 283(112452). https://doi.org/10.1016/j.psychres.2019.06.027 ‌ Pre-Post Study: Definition, Advantages, and Drawbacks. (n.d.). Www.withpower.com. https://www.withpower.com/guides/pre-post-study