SAMHSA Evaluation
I will first report the statistical information that SAMSHA provides and then I will go into the one published article that was provided as one of the studies. SAMHSA states that there is a rating scare of 0.0 to 4.0 and they have six criteria that they use for each of their EBP for their quality of research rating. The six criteria go as: reliability of measures, validity of measures, intervention fidelity, missing data and attrition, potential confounding variables, and appropriateness of analysis (SAMHSA, 2008). The outcomes that they used for Active Parenting were: parental perceptions of child behavior, parental aptitudes and beliefs, parent-child relationship problems, and positive and negative child behaviors (SAMHSA, 2008).
Within …show more content…
the scores, you see a mixture of strong and weak scores. For example, you see 4.0 in reliability of measure in parent-child relationship problems. You also have a 0.0 in reliability of measure for positive and negative child behaviors. That is the only 0.0 that Active Parenting does receive in the whole set. Over ratings follow as: parental perceptions of child behavior: 3.1, parental aptitudes and beliefs: 3.1, parent-child relationship problems: 3.3, and positive and negative child behaviors: 2.2 (SAMHSA, 2008). If I am going based off these scores alone, and not reading what SAMHSA tells me before, EBP wise, it is not the strongest EPB out there and at the same not, it is not the worse one either. I do struggle, as I stated before, that these numbers are coming from two studies that have not been published.
SAMHSA (2008) does state that reliability and validity is sufficient and I would agree due to the scores being decent until you reach the fourth outcome where Active Parenting receives 0.0 and 1.4.
My understanding of intervention fidelity is that however the intervention is delivered, it does what it intended to do. Active Parenting uses a video system SAMSA stated that Active Parenting uses a video system and a Leader Guide and is structure to deliver the material for its intervention. One of the studies, it did rate low, however the other two studies the had a higher rating score with the intervention fidelity (2008). According to SAMHSA (2008) there were control groups and the control groups used a wait-list approach. Randomization within the groups were not used, however in one study the two groups “were equivalent on all measured demographic and assessment variables at pretest. The data analyses conducted were appropriate.” (SAMHSA, …show more content…
2008).
SAMSHA (2008) gave Active Parenting (4th Edition) an overall rating scale of 3.2 out of a 4.0 rating system. When I look at that number, I really struggle with how I feel about it because I know that two of the studies they used are unpublished and I do not have access to those studies. There is information in those studies that I cannot read for myself that could influence how I feel about this program and whether it is something that I would want to seek to use in my professional career. Which leads me to the study that I do have access too.
Fashimpar (2000) set out with six hypotheses for this study, some of which are: “Hypothesis 1: Subjects will have more appropriate development expectations for children after completing the Active Parenting program. Untrained subjects will not significantly change their developmental expectations for their children. Hypothesis 2: There will be an increase in subjects’ empathy with their children by the completion of Active Parenting. Untrained subjects will not change in their ability to empathize with their children” (70).
Fashimpar (2000) recruited through multiple resources and gathered 88 volunteers for the study, which than was narrowed down to 68. The article stated that “Thus, the sample lacked randomization and the groups lacked random assignment. Nevertheless, the treatment and comparison groups were equivalent on all measured variables” (Fashimpar, 2000, p.73). There were multiple different assessments used to help gather the data.
The data showed that the results were either “not significant” or “statistically insignificant”, however, when it came to within the treatment group they “significantly improved their attitudes toward physical punishment but demonstrated no improvement in empathy for children, expectations for children, or in beliefs about family roles” (Fashimpar, 2000, p.75-76). Fashimpar (2000) did wonder if maybe the assessment failed to measure the change and that is why Active Parenting appears to fail at doing what it intends to do. He does state that it does demonstrate that Active Parenting is an effective treatment in “reducing serious parent-child relationship problems” and that it “may be ineffective in changing dysfunctional attitudes toward empathy, developmental expectations and family roles” (Fashimpar, 2000, p.78-79).
Applying the Evidence Base Program If this was a group I was going to run, then I would have to go through the training for it to be appropriate it me to teach this to parents. I would go to Active Parenting website and work through the process of becoming certified within their program. Once I become certified to teach this group to parents, then I will set up a small group at my site and run my very first group to see how the experience goes and learn from my mistakes.
One of the first steps I would do is work with my site to find a day and time that would work for me to run my group. Since I am working with parents, I would be running this as an evening program and I would need permission from my site that it would be ok to run a group that late in the evening, or if the group would start during operating hours and end after operating hours. Then the next step would be working on how I would advertise my group, I would advertise within my site through the other counselors, case managers, Community Based Rehabilitative Service worker (CBRS), and the website.
Assess and Monitor the Outcome When it comes to assessing and monitoring the outcome of the group, I had wondered how I would go about it.
So far in my real-life experiences, none of my groups have done it and it does seem like a missed opportunity. In the one parenting group, we have done verbal assessments, however, that is hard to track when it comes down to it. I think of insurance panels wanting to see why groups are beneficial, and how I could already have information to have them. PCOMS could be something I used to monitor my group, it’s one of the many assessment tools out there. The wonderful thing about PCOMS is that is have validity and reliability to support it, verses me just making something up so if insurance panels wanted something I would have a strong assessment to support myself. I also know that I could do more research and find another assessment tool that would work just as well for my group because I have the tools due to this class and assessments to know what is a reliable and valid
tool.
Within …show more content…
the scores, you see a mixture of strong and weak scores. For example, you see 4.0 in reliability of measure in parent-child relationship problems. You also have a 0.0 in reliability of measure for positive and negative child behaviors. That is the only 0.0 that Active Parenting does receive in the whole set. Over ratings follow as: parental perceptions of child behavior: 3.1, parental aptitudes and beliefs: 3.1, parent-child relationship problems: 3.3, and positive and negative child behaviors: 2.2 (SAMHSA, 2008). If I am going based off these scores alone, and not reading what SAMHSA tells me before, EBP wise, it is not the strongest EPB out there and at the same not, it is not the worse one either. I do struggle, as I stated before, that these numbers are coming from two studies that have not been published.
SAMHSA (2008) does state that reliability and validity is sufficient and I would agree due to the scores being decent until you reach the fourth outcome where Active Parenting receives 0.0 and 1.4.
My understanding of intervention fidelity is that however the intervention is delivered, it does what it intended to do. Active Parenting uses a video system SAMSA stated that Active Parenting uses a video system and a Leader Guide and is structure to deliver the material for its intervention. One of the studies, it did rate low, however the other two studies the had a higher rating score with the intervention fidelity (2008). According to SAMHSA (2008) there were control groups and the control groups used a wait-list approach. Randomization within the groups were not used, however in one study the two groups “were equivalent on all measured demographic and assessment variables at pretest. The data analyses conducted were appropriate.” (SAMHSA, …show more content…
2008).
SAMSHA (2008) gave Active Parenting (4th Edition) an overall rating scale of 3.2 out of a 4.0 rating system. When I look at that number, I really struggle with how I feel about it because I know that two of the studies they used are unpublished and I do not have access to those studies. There is information in those studies that I cannot read for myself that could influence how I feel about this program and whether it is something that I would want to seek to use in my professional career. Which leads me to the study that I do have access too.
Fashimpar (2000) set out with six hypotheses for this study, some of which are: “Hypothesis 1: Subjects will have more appropriate development expectations for children after completing the Active Parenting program. Untrained subjects will not significantly change their developmental expectations for their children. Hypothesis 2: There will be an increase in subjects’ empathy with their children by the completion of Active Parenting. Untrained subjects will not change in their ability to empathize with their children” (70).
Fashimpar (2000) recruited through multiple resources and gathered 88 volunteers for the study, which than was narrowed down to 68. The article stated that “Thus, the sample lacked randomization and the groups lacked random assignment. Nevertheless, the treatment and comparison groups were equivalent on all measured variables” (Fashimpar, 2000, p.73). There were multiple different assessments used to help gather the data.
The data showed that the results were either “not significant” or “statistically insignificant”, however, when it came to within the treatment group they “significantly improved their attitudes toward physical punishment but demonstrated no improvement in empathy for children, expectations for children, or in beliefs about family roles” (Fashimpar, 2000, p.75-76). Fashimpar (2000) did wonder if maybe the assessment failed to measure the change and that is why Active Parenting appears to fail at doing what it intends to do. He does state that it does demonstrate that Active Parenting is an effective treatment in “reducing serious parent-child relationship problems” and that it “may be ineffective in changing dysfunctional attitudes toward empathy, developmental expectations and family roles” (Fashimpar, 2000, p.78-79).
Applying the Evidence Base Program If this was a group I was going to run, then I would have to go through the training for it to be appropriate it me to teach this to parents. I would go to Active Parenting website and work through the process of becoming certified within their program. Once I become certified to teach this group to parents, then I will set up a small group at my site and run my very first group to see how the experience goes and learn from my mistakes.
One of the first steps I would do is work with my site to find a day and time that would work for me to run my group. Since I am working with parents, I would be running this as an evening program and I would need permission from my site that it would be ok to run a group that late in the evening, or if the group would start during operating hours and end after operating hours. Then the next step would be working on how I would advertise my group, I would advertise within my site through the other counselors, case managers, Community Based Rehabilitative Service worker (CBRS), and the website.
Assess and Monitor the Outcome When it comes to assessing and monitoring the outcome of the group, I had wondered how I would go about it.
So far in my real-life experiences, none of my groups have done it and it does seem like a missed opportunity. In the one parenting group, we have done verbal assessments, however, that is hard to track when it comes down to it. I think of insurance panels wanting to see why groups are beneficial, and how I could already have information to have them. PCOMS could be something I used to monitor my group, it’s one of the many assessment tools out there. The wonderful thing about PCOMS is that is have validity and reliability to support it, verses me just making something up so if insurance panels wanted something I would have a strong assessment to support myself. I also know that I could do more research and find another assessment tool that would work just as well for my group because I have the tools due to this class and assessments to know what is a reliable and valid
tool.