Context, process, and participant response in the implementation of family support programmes in Spain

  1. Sonia Byrne 1
  2. Silvia López-Larrosa 2
  3. Juan C. Martín 3
  4. Enrique Callejas 1
  5. María L. Máiquez 1
  6. María J. Rodrigo 1
  1. 1 Universidad de La Laguna, Tenerife
  2. 2 Universidade da Coruña
    info

    Universidade da Coruña

    La Coruña, España

    ROR https://ror.org/01qckj285

  3. 3 Universidad de Las Palmas de Gran Canaria
    info

    Universidad de Las Palmas de Gran Canaria

    Las Palmas de Gran Canaria, España

    ROR https://ror.org/01teme464

Journal:
Psicología educativa

ISSN: 1135-755X

Year of publication: 2023

Volume: 29

Issue: 1

Pages: 25-33

Type: Article

DOI: 10.5093/PSED2022A8 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Psicología educativa

Metrics

Cited by

  • Scopus Cited by: 0 (17-02-2024)
  • Web of Science Cited by: 0 (28-10-2023)
  • Dimensions Cited by: 0 (03-01-2024)

JCR (Journal Impact Factor)

(Indicator corresponding to the last year available on this portal, year 2022)
  • Year 2022
  • Journal Impact Factor: 1.9
  • Journal Impact Factor without self cites: 1.9
  • Article influence score: 0.36
  • Best Quartile: Q3
  • Area: PSYCHOLOGY, MULTIDISCIPLINARY Quartile: Q3 Rank in area: 91/147 (Ranking edition: SSCI)
  • Area: EDUCATION & EDUCATIONAL RESEARCH Quartile: Q3 Rank in area: 176/269 (Ranking edition: SSCI)
  • Area: PSYCHOLOGY, EDUCATIONAL Quartile: Q4 Rank in area: 47/60 (Ranking edition: SSCI)

SCImago Journal Rank

(Indicator corresponding to the last year available on this portal, year 2022)
  • Year 2022
  • SJR Journal Impact: 0.491
  • Best Quartile: Q3
  • Area: Developmental and Educational Psychology Quartile: Q3 Rank in area: 188/349
  • Area: Social Psychology Quartile: Q3 Rank in area: 154/299

Índice Dialnet de Revistas

(Indicator corresponding to the last year available on this portal, year 2022)
  • Year 2022
  • Journal Impact: 1.980
  • Field: PSICOLOGÍA Quartile: C1 Rank in field: 12/109
  • Field: EDUCACIÓN Quartile: C1 Rank in field: 11/232

CIRC

  • Social Sciences: A

Scopus CiteScore

(Indicator corresponding to the last year available on this portal, year 2022)
  • Year 2022
  • CiteScore of the Journal : 2.7
  • Area: Developmental and Educational Psychology Percentile: 48
  • Area: Social Psychology Percentile: 47

Journal Citation Indicator (JCI)

(Indicator corresponding to the last year available on this portal, year 2022)
  • Year 2022
  • Journal Citation Indicator (JCI): 0.63
  • Best Quartile: Q2
  • Area: PSYCHOLOGY, MULTIDISCIPLINARY Quartile: Q2 Rank in area: 104/215
  • Area: EDUCATION & EDUCATIONAL RESEARCH Quartile: Q3 Rank in area: 395/759
  • Area: PSYCHOLOGY, EDUCATIONAL Quartile: Q3 Rank in area: 50/73

Dimensions

(Data updated as of 03-01-2024)
  • Total citations: 0
  • Recent citations (2 years): 0

Abstract

Implementation research addresses how well a programme is conducted when applied in real-world conditions. However, research based on quality standards is still scarce as it requires monitoring context, process, and participant response. This study applies implementation quality standards to 57 Spanish parenting and family support programmes identified in the COST European Family Support Network project, using an ten-component evaluation sheet sheet. Descriptive analyses showed a good implementation level. The latent profile analysis identified four patterns defined by programme setting: profile 1, Social Services/NGO setting (21.1%), profile 2, Health setting (31.6%), profile 3, Multi-setting (14%), and profile 4, Educational setting (33.3%), differing in professional discipline, training, participant response, and professional perception of implementation. Profile memberships were related to programme outcomes, scaling up, and sustainability. Findings illustrate conceptual and practical challenges that researchers and professionals usually encounter during implementation, and the efforts required to deliver programmes effectively in real-world settings in Spain.

Bibliographic References

  • Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716-723. https://doi. org/10.1109/TAC.1974.1100705
  • Álvarez, I., Herrero, M., Martínez-Pampliega, A., & Escudero, V. (2020). Measuring perceptions of the therapeutic alliance in individual, family, and group therapy from a systemic perspective: structural validity of the SOFTA-s. Family Process, 60(2), 302-315. https://doi.org/10.1111/ famp.12565
  • Álvarez, M., Padilla, S., & Máiquez, M. L. (2016). Home and group-based implementation of the “Growing up happily in the family” program in at-risk psychosocial contexts. Psychosocial Intervention, 25(2), 69-78. https://doi.org/10.1016/j.psi.2016.03.006
  • Amorós-Martí, P., Byrne, S., Mateos-Inchaurrondo, A., Vaquero-Tió, E., & Mundet-Bolós, A. (2016). “Learning together, growing with family”: The implementation and evaluation of a family support programme. Psychosocial Intervention, 25(2), 87-93. https://doi.org/10.1016/j. psi.2016.02.002
  • Arranz, E. B., Olabarrieta, F., Manzano, A., Martín, J. L., Cruz, N., & Etxaniz, A. (2016). Assessment of positive parenting programmes in the Autonomous Region of the Basque Country (Spain). Psychosocial Intervention, 25(2), 127-134. https://doi.org/10.1016/j.psi.2016.03.003
  • Arruabarrena, M. I., & de Paúl, J. (2012). Early intervention programs for children and families: Theoretical and empirical bases supporting their social and economic efficiency. Psychosocial Intervention, 21(2), 117-127. https://doi.org/10.5093/in2012a18
  • Bennet, C., Barlow, J., Huband, N., Smailagic, N., & Roloff, V. (2013). Groupbased parenting programs for improving parenting and psychosocial functioning: A systematic review. Journal of the Society for Social Work and Research, 4(4), 300-332. https://doi.org/10.5243/jsswr.2013.20
  • Bergman, L. R., Magnusson, D., & Khourt, E. (2003). Studying individual development in an interindividual context: A person-oriented approach. Psychology Press.
  • Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12(1), 23-33. https://doi.org/10.1007/s11121-010-0186-1
  • Bradley, R. H. (2007). Parenting in the breach: How parents help children cope with developmentally challenging circumstances. Parenting: Science and Practice, 7(2), 99-148. https://doi. org/10.1080/15295190701306896
  • Budd, K. S. (2005). Assessing parenting capacity in a child welfare context. Children and Youth Services Review, 27(4), 429-444. https://doi. org/10.1016/j.childyouth.2004.11.008
  • Canário, A. C., Byrne, S., Creasey, N., Kody ová, E., Kömürcü Akik, B., Lewandowska-Walter, A., Modic Stanke, K., Pecnik, N., & Leijten, P. (2022). The use of information and communication technologies in family support across Europe: A narrative review. International Journal of Environmental Research and Public Health, 19(3), Article 1488. https://doi.org/10.3390/ijerph19031488
  • Cohen, J. (1988), Statistical power analysis for the behavioral sciences. Lawrence Erlbaum.
  • Consejo de Europa. (2006). Recomendación Rec(2006)19 del Comité de Ministros a los Estados miembros sobre políticas de apoyo a la parentalidad positiva. https://www.mscbs.gob.es/ssi/familiasInfancia/ parentalidadPos2012/docs/informeRecomendacion.pdf
  • Daly, M. (2013). Parenting support policies in Europe. Families, Relationships and Societies, 2(2), 159-174. https://doi. org/10.1332/204674313X666886
  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) Fostering Implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, Article 50. https://doi.org/10.1186/1748-5908-4-50
  • De Paúl, J. (2012). Editorial comment. Evidence-based programs for children, youth, and families: Introduction to the Special Issue. Psychosocial Intervention, 21(2), 113-115. https://doi.org/10.5093/in2012a19
  • Durlak, J. A. (2015a). Studying program implementation is not easy but it is essential. Prevention Science,16(8), 1123-1127. https://doi.org/10.1007/ s11121-015-0606-3
  • Durlak, J. A. (2015b). What everyone should know about implementation. In J. A. Durlak, C. E. Domitrovich, R. P. Weissberg, & T. P. Gullotta (Eds.), Handbook of social and emotional learning: Research and practice (pp. 395-405). The Guilford Press.
  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3-4), 327-350. https://doi.org/10.1007/ s10464-008-9165-0
  • Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mo cicki, E. K., Schinke, S., Valentine, J. C., & Jiet, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6(3), 151-75. https://doi.org/10.1007/s11121-005- 5553-y
  • Goldstein, H., & Olswang, L. (2017). Is there a science to facilitate implementation of evidence-based practices and programs? EvidenceBased Communication Assessment and Intervention, 11(3-4), 55-60. https://doi.org/10.1080/ 17489539.2017.1416768
  • Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16(7), 893-926. https://doi. org/10.1007/s11121-015-0555-x
  • Hickey, G., McGilloway, S., Leckey, Y., Stokes, A., Bywater, T., & Donnelly, M. (2021). “Putting meat on the bones”: Understanding the implementation of a community-based early intervention and prevention programme— contextual, person, and programme influences. Prevention Science, 22(1), 113-129. https://doi.org/10.1007/s11121-020-01170-y
  • Hidalgo, M.V., Jiménez, L., López-Verdugo, I., Lorence, B., & Sánchez, J. (2016). “Family Education and Support” program for families at psychosocial risk: The role of implementation process. Psychosocial Intervention, 25(2), 79-85. https://doi.org/10.1016/j.psi.2016.03.002
  • Laosa, L. M., & Sigel, I. E. (1982). Families as learning environments for children. Springer. https://doi.org/10.1007/978-1-4684-4172-7
  • Lebow, J. L. (2021). Couple and family therapy (and families) in the digital age. Family Process, 60(3), 689-693. https://doi.org/10.1111/ famp.12705
  • Lehrl, S., Evangelou, M., & Sammons, P. (2020) The home learning environment and its role in shaping children’s educational development. School Effectiveness and School Improvement, 31(1), 1-16. https://doi.org/10.1080/09243453.2020.1693487
  • Lo, Y., Mendell, N. R., & Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767-778. https:// doi.org/10.1093/biomet/88.3.767
  • López Larrosa, S. (2001). La familia como contexto de aprendizaje de padres e hijos: límites, estructura y condiciones individuales. Bordón, 53(1), 73-88.
  • López-Larrosa, S., & Escudero, V. (2003). Familia, evaluación e intervención. CCS.
  • Magnusson, D. (1998). The logic and implications of a person approach. In R.B. Cairns, L.R. Bergman & J. Kagan (Eds.), Methods and models for studying the individual (pp. 33-63). Sage.
  • Martínez-González, R. A., Rodríguez-Ruiz, B., Álvarez-Blanco, L., & Becedóniz-Vázquez, C. (2016). Evidence in promoting positive parenting through the program-guide to develop emotional competences. Psychosocial Intervention, 25(2), 111-117. https://doi. org/10.1016/j.psi.2016.04.001
  • Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3-4), 462-480. https://doi.org/10.1007/s10464-012-9522-xhttps:// doi.org/10.1007/s10464-012-9522-x
  • Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (7th edition). Muthén & Muthén.
  • Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14(4), 535-569. https://doi.org/10.1080/10705510701575396
  • Nystrand, C., Hultkrantz, L., Vimefall, E., & Feldman, I. (2020). Economic return on investment of parent training programmes for the prevention of child externalising behaviour problems. Administration and Policy in Mental Health and Mental Health Services Research, 47(2), 300-315. https://doi.org/10.1007/s10488-019-00984-5
  • Orte, C., Ballester, L., Vives, M., & Ame, J. (2016). Quality of implementation in an evidence-based family prevention program: “The family competence program”. Psychosocial Intervention, 25(2), 95-10. https://doi.org/10.1016/j.psi.2016.03.005
  • Peters, D. H., Adam, T., Alonge, O., Agyepong, I. A., & Tran, N. (2013). Implementation research: What it is and how to do it. BMJ, 347, Article f6753. https://doi.org/ 10.1136/bmj.f6753
  • Pinto, R., Canário, C., Cruz, O., & Rodrigo, M.J. (2021) Implementation of evidence-based parenting programs under real-world conditions: Protocol for a scoping review. PLoS ONE, 16(8), e0256392. https://doi. org/10.1371/journal.pone.0256392
  • Powers, J., Maley, M., Purington, A., Schantz, K., & Dotterweich, J. (2015). Implementing evidence-based programs: Lessons learned from the field. Applied Developmental Science, 19(2), 108-116. https://doi. org/10.1080/10888691. 2015.1020155
  • Reder, P., Duncan, S., & Lucey, C. (2003). Studies in the assessment of parenting. Routledge.
  • Rodríguez-Gutiérrez, E., Martín-Quintana, J. C., & Cruz-Sosa, M. (2016). “Living adolescence in family” parenting program: Adaptation and implementation in social and school contexts. Psychosocial Intervention, 25(2), 103-110. https://doi.org/10.1016/j.psi.2016.03.004
  • Rodrigo, M. J. (2016). Quality of implementation in evidence-based positive parenting programs in Spain: Introduction to the Special Issue. Psychosocial Intervention, 25(2), 63-68. https://doi.org/10.1016/j. psi.2016.02.004
  • Rodrigo, M. J., Almeida, A., & Reichle, B. (2016). Evidence-based parent education programs: A European perspective. In J. Ponzetti (Ed.), Evidence-based parenting education: A global perspective (pp. 85- 104). Routledge/Taylor and Francis Group.
  • Rodrigo, M. J., Máiquez, M. L., & Martín-Quintana, J. C. (2010). La educación parental como recurso psicoeducativo para promover la parentalidad positiva. Ministerio de Sanidad Servicios Sociales e Igualdad.
  • Rodrigo, M. J., Máiquez, M. L., Martín Quintana, J. C., Byrne, S., & Rodríguez Ruiz, B. (2015). Manual práctico de parentalidad positiva. Síntesis.
  • Sanders, M. R., Healy, K. L., Grice, C., & Del Vecchio, T. (2017). Evidence-based parenting programs: integrating science into school-based practice. In M. Thielking & M. Terjesen (Eds), Handbook of Australian School Psychology (pp. 537-551). Springer. https://doi.org/10.1007/978-3- 319-45166-4_27
  • Schwartz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461-464. https://doi.org/10.1214/aos/1176344136 Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52(3), 333-343. https://doi.org/10.1007/BF02294360
  • Shapiro, C. J., Prinz, R. J., & Sanders, M. R. (2012). Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: The triple P-Positive Parenting Program. Child Maltreatment, 17(1), 86-95. https://doi. org/10.1177/1077559511424774
  • Smith, J. D., Cruden, G. H., Rojas, L. M., Ryzin, M. Van, Fu, E., Davis, M. M., Landsverk, J., & Brown, C. H. (2020). Parenting interventions in pediatric primary care: A systematic review. Pediatrics, 146(1), e20193548. https://doi.org/10.1542/peds.2019-3548
  • Stern, S. B., Alaggia, R., Watson, K., & Morton, T. R. (2008). Implementing an evidence-based parenting program with adherence in the real world of community practice. Research on Social Work Practice, 18(6), 543-554. https://doi.org/ 10.1177/1049731507308999
  • Suárez, A., Rodríguez, J. A., & Rodrigo, M. J., (2016). The Spanish online program “Educar en positivo” [“The positive parent”: Whom does it benefit the most?] Psychosocial Intervention, 25(2), 119-126. https:// doi.org/10.1016/j.psi.2016.03.001
  • Sujan, A., & Eckenrode, J. (2017). An illustration of how program implementers can use population-specific analyses to facilitate the selection of evidence-based home visiting programs. Psychosocial Intervention, 26(2), 117-124. https://doi.org/10.1016/j.psi.2017.01.001
  • Temcheff, C. E., Letarte, M. J., Boutin, S., & Marcil, K. (2018). Common components of evidence-based parenting programs for preventing maltreatment of school-age children. Child Abuse & Neglect, 80, 226- 237. https://doi.org/10.1016/j.chiabu.2018.02.004
  • Weegar, K., Moorman, J., Stenason, L., & Romano, E. (2018). Perspectives on the implementation of an evidence-based neglect program within child welfare. Children and Youth Services Review, 93, 474-483. https://doi.org/10.1016/j.childyouth.2018.08.035
  • Whitcombe-Dobbs, S., & Tarren-Sweeney, M. (2019). What evidence is there that parenting interventions reduce child abuse and neglect among maltreating families? A systematic review. Developmental Child Welfare, 1(4) 374-393. https://doi.org/10.1177/2516103219893383
  • World Health Organization (WHO, 2020). Strengthening stakeholder collaboration for the prevention of violence against children in priority countries. https://www.euro.who.int/__data/assets/pdf_ file/0011/458678/intersectoral-collaboration-violence-preventionchildren.pdf
  • Wurpts, I. C., & Geiser, C. (2014). Is adding more indicators to a latent class analysis beneficial or detrimental? Results of a Monte-Carlo study. Frontiers of Psychology, 5, Article 920. https://doi.org/10.3389/ fpsyg.2014.00920
  • Zuchowski, I., Miles, D., Woods, C., & Tsey, K. (2019). Continuous quality improvement processes in child protection: A systematic literature review. Research on Social Work Practice, 29(4), 389-400. https://doi. org/10.1177/1049731517743337