Improving the Methodological, Analytical, and Cultural Impact of Behavior Analysis Via Utilization of Group Design Methods and Statistical Analyses
Abstract
The multi-decade debates within the field of behavior analysis as to the possible value and threat of group design methodology and statistical analyses on the purity of the field have weakened the discipline’s maximal impact on the world. This paper rebukes the concerns and suggests that through such adoption behavior analysis may likely better achieve its world-changing ideals, and pragmatic initiatives. We begin with a historical trace of the current debate and describe the pros and cons to design/analysis inclusion, frame such matters within the context of contemporary issues which applied behavior analysts find themselves concerned, and ultimately put forward means by which broader, and perhaps more impactful, research questions can be asked and interpreted.
References
- Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavioral Education, 28(3), 362-388. https://doi.org/10.1007/s10864-019-09327-8
- Ator, N. A. (1999). Statistical inference in behavior analysis: Environmental determinants? The Behavior Analyst, 22(2), 93-97. https://doi.org/10.1007/BF03391985
- Ayllon, T., & Kelly, K. (1972). Effects of reinforcement on standardized test performance. Journal of Applied Behavior Analysis, 5(4), 477-484. https://doi.org/10.1901/jaba.1972.5-477
- Baires, N. A., Catrone, R., & May, B. K. (2022). On the Importance of listening and intercultural communication for actions against racism. Behavior Analysis in Practice, 15(4), 1042-1049. https://doi.org/10.1007/s40617-021-00629-w
- Beavers, G. A., Iwata, B. A., & Lerman, D. C. (2013). Thirty years of research on the functional analysis of problem behavior. Journal of Applied Behavior Analysis, 46(1), 1-21. https://doi.org/10.1002/jaba.30
- Becirevic, A., Critchfield, T. S., & Reed, D. D. (2016). On the social acceptability of behavior-analytic terms: Crowdsourced comparisons of lay and technical language. The Behavior Analyst, 39(2), 305-317. https://doi.org/10.1007/s40614-016-0067-4
- Belisle, J., Stanley, C. R., & Dixon, M. R. (2021). Research methods for the practicing behavior analyst. Emergent Press LLC.
- Bloom, M., Fischer, J., & Orme, J. G. (2009). Evaluating practice : Guidelines for the accountable professional (5th ed.). Allyn and Bacon.
- Bolgar, H. (1965). The case study method. In B. B. Wolman (Ed.), Handbook of clinical psychology. McGraw-Hill.
- Bracken, B. A. (2007). Bracken School Readiness Assessment Third Edition. The Psychological Corporation.
- Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled rffectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12(3), 133-148. https://doi.org/10.1177/1098300709334798
- Bradshaw, C. P., Waasdorp, T. E., & Leaf, P. J. (2012). Effects of school-wide positive behavioral interventions and supports on child behavior problems. Pediatrics, 130(5), 1136-1145. https://doi.org/10.1542/peds.2012-0243
- Branch, M. N. (1999). Statistical inference in behavior analysis: Some things significance testing does and does not do. The Behavior Analyst, 22(2), 87-92. https://doi.org/10.1007/BF03391984
- Čolić, M., Araiba, S., Lovelace, T. S., & Dababnah, S. (2022). Black caregivers’ perspectives on racism in ASD services: Toward culturally responsive ABA practice. Behavior Analysis in Practice, 15(4), 1032-1041. https://doi.org/10.1007/s40617-021-00577-5
- Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis. Pearson Education, Inc.
- Cooper, J. O., Heron, T. E., & Heward, W. L. (2020). Analyzing behavior change: Basic assumptions and strategies. In Applied behavior analysis third edition. Pearson Education.
- Crosbie, J. (1999). Statistical inference in behavior analysis: Useful friend. The Behavior Analyst, 22(2), 105-108. https://doi.org/10.1007/BF03391987
- Davison, M. (1999). Statistical inference in behavior analysis: Having my cake and eating it? The Behavior Analyst, 22(2), 99-103. https://doi.org/10.1007/BF03391986
- DeFelice, K. A., & Diller, J. W. (2019). Intersectional feminism and behavior analysis. Behavior Analysis in Practice, 12(4), 831-838. https://doi.org/10.1007/s40617-019-00341-w
- Deochand, N., & Costello, M. S. (2022). Building a social justice framework for cultural and linguistic diversity in ABA. Behavior Analysis in Practice, 15(3), 893-908. https://doi.org/10.1007/s40617-021-00659-4
- DeRosa, N. M., Novak, M. D., Morley, A. J., & Roane, H. S. (2019). Comparing response blocking and response interruption/redirection on levels of motor stereotypy: Effects of data analysis procedures. Journal of Applied Behavior Analysis, 52(4), 1021-1033. https://doi.org/10.1002/jaba.644
- Dixon, M. R., Belisle, J., Rehfeldt, R. A., & Root, W. B. (2018). Why we are still not acting to save the world: The upward challenge of a post-Skinnerian behavior science. Perspectives on Behavior Science, 41(1), 241-267. https://doi.org/10.1007/s40614-018-0162-9
- Dixon, M. R., Hayes, S. C., & Belisle, J. (2023). Acceptance and Commitment Therapy for Behavior Analysts: A practical guide from theory to treatment. Taylor & Francis LTD.
- Dixon, M. R., Paliliunas, D., Barron, B. F., Schmick, A. M., & Stanley, C. R. (2021). Randomized controlled trial evaluation of ABA content on IQ gains in children with autism. Journal of Behavioral Education, 30(3), 455-477. https://doi.org/10.1007/s10864-019-09344-7
- Dixon, M. R., Paliliunas, D., Weber, J., & Schmick, A. M. (2022). A large-scale naturalistic evaluation of the AIM curriculum in a public-school setting. Behavior Analysis in Practice, 15(1), 156-170. https://doi.org/10.1007/s40617-021-00569-5
- Dixon, M. R., Rowsey, K. E., Gunnarsson, K. F., Belisle, J., Stanley, C. R., & Daar, J. H. (2017). Normative sample of the PEAK relational training system: Generalization module with comparison to individuals with autism. Journal of Behavioral Education, 26(1), 101-122. https://doi.org/10.1007/s10864-016-9261-4
- Dowdy, A., Jessel, J., Saini, V., & Peltier, C. (2022). Structured visual analysis of single-case experimental design data: Developments and technological advancements. Journal of Applied Behavior Analysis, 55(2), 451-462. https://doi.org/10.1002/jaba.899
- Dubuque, E. M., & Kazemi, E. (2022). An investigation of BCBA exam pass rates as a quality indicator of applied behavior analysis training programs. Behavior Analysis in Practice, 15(3), 909-923. https://doi.org/10.1007/s40617-021-00660-x
- Duncan, O. D. (1969). Some linear models for two-wave, two-variable panel analysis. Psychological Bulletin, 72, 177-182. https://doi.org/10.1037/h0027876
- Dunn, K. E., Sigmon, S. C., Thomas, C. S., Heil, S. H., & Higgins, S. T. (2008). Voucher-based contingent reinforcement of smoking abstinence among methadone-maintained patients: A pilot study. Journal of Applied Behavior Analysis, 41(4), 527-538. https://doi.org/10.1901/jaba.2008.41-527
- Fontenot, B., Uwayo, M., Avendano, S. M., & Ross, D. (2019). A descriptive analysis of applied behavior analysis research with economically disadvantaged children. Behavior Analysis in Practice, 12(4), 782-794. https://doi.org/10.1007/s40617-019-00389-8
- Gatzunis, K. S., Edwards, K. Y., Rodriguez Diaz, A., Conners, B. M., & Weiss, M. J. (2022). Cultural responsiveness framework in BCBA® supervision. Behavior Analysis in Practice, 15(4), 1373-1382. https://doi.org/10.1007/s40617-022-00688-7
- Gollub, L. R. (2002). Between the waves: Harvard pigeon lab 1955–1960. Journal of the Experimental Analysis of Behavior, 77(3), 319-326. https://doi.org/10.1901/jeab.2002.77-319
- Gottman, J. M., McFall, R. M., & Barnett, J. T. (1969). Design and analysis of research using time series. Psychological Bulletin, 72, 299-306. https://doi.org/10.1037/h0028021
- Habib, R., & Dixon, M. R. (2010). Neurobehavioral evidence for the “near-miss” effect in pathological gamblers. Journal of the Experimental Analysis of Behavior, 93(3), 313-328. https://doi.org/10.1901/jeab.2010.93-313
- Heil, S. H., Johnson, M. W., Higgins, S. T., & Bickel, W. K. (2006). Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addictive Behaviors, 31(7), 1290-1294. https://doi.org/10.1016/j.addbeh.2005.09.005
- Higgins, S. T., Budney, A. J., Bickel, W. K., Foerg, F. E., Donham, R., & Badger, G. J. (1994). Incentives improve outcome in outpatient behavioral treatment of cocaine dependence. Archives of general psychiatry, 51(7), 568-576. https://doi.org/10.1001/archpsyc.1994.03950070060011
- Higgins, S. T., Delaney, D. D., Budney, A. J., Bickel, W. K., Hughes, J. R., Foerg, F., & Fenwick, J. W. (1991). A behavioral approach to achieving initial cocaine abstinence. American Journal of Psychiatry, 148(9), 1218-1224. https://doi.org/10.1176/ajp.148.9.1218
- Higgins, S. T., Kurti, A. N., & Davis, D. R. (2019). Coucher-based contingency management is efficacious but underutilized in treating addictions. Perspectives on Behavior Science, 42(3), 501-524. https://doi.org/10.1007/s40614-019-00216-z
- Horner, R. H., & Sugai, G. (2015). School-wide PBIS: An example of applied behavior analysis implemented at a scale of social importance. Behavior Analysis in Practice, 8(1), 80-85. https://doi.org/10.1007/s40617-015-0045-4
- Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., & Esperanza, J. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11(3), 133-144. https://doi.org/10.1177/1098300709332067
- Howell, D. C. (2012). Statistical methods for psychology. Cengage Learning.
- Jaramillo, C., & Nohelty, K. (2022). Guidance for behavior analysts in addressing racial implicit bias. Behavior Analysis in Practice, 15(4), 1170-1183. https://doi.org/10.1007/s40617-021-00631-2
- Jang, J., Dixon, D. R., Tarbox, J., Granpeesheh, D., Kornack, J., & de Nocker, Y. (2012). Randomized trial of an eLearning program for training family members of children with autism in the principles and procedures of applied behavior analysis. Research in Autism Spectrum Disorders, 6(2), 852-856.
- Joslyn, P. R., Donaldson, J. M., Austin, J. L., & Vollmer, T. R. (2019). The Good Behavior Game: A brief review. Journal of Applied Behavior Analysis, 52(3), 811-815. https://doi.org/10.1002/jaba.572
- Keppel, G. (1982). Design and analysis: A researcher's handbook (2nd ed.). Prentice-Hall.
- Kirkham, P. (2017). “The line between intervention and abuse” – autism and applied behaviour analysis. History of the Human Sciences, 30(2), 107-126. https://doi.org/10.1177/0952695117702571
- Koegel, L. K., Koegel, R. L., & Smith, A. (1997). Variables related to differences in standardized test outcomes for children with autism. Journal of Autism and Developmental Disorders, 27(3), 233-243. https://doi.org/10.1023/A:1025894213424
- Kolb, R. L., Robers, A. C., Brown, C., & McComas, J. J. (2022). Beyond cultural responsivity: Applied Behavior Analysis through a lens of cultural humility. In Handbook of special education research (Vol. I, pp. 144-157). Routledge.
- Kornack, J., Cernius, A., & Persicke, A. (2019). The diversity Is in the details: Unintentional language discrimination in the practice of applied behavior analysis. Behavior Analysis in Practice, 12(4), 879-886. https://doi.org/10.1007/s40617-019-00377-y
- Kupferstein, H. (2018). Evidence of increased PTSD symptoms in autistics exposed to applied behavior analysis. Advances in Autism, 4(1), 19-29. https://doi.org/10.1108/AIA-08-2017-0016
- Kurtz, P. F., Fodstad, J. C., Huete, J. M., & Hagopian, L. P. (2013). Caregiver- and staff-conducted functional analysis outcomes: A summary of 52 cases. Journal of Applied Behavior Analysis, 46(4), 738-749. https://doi.org/10.1002/jaba.87
- Kyonka, E. G. E., Mitchell, S. H., & Bizo, L. A. (2019). Beyond inference by eye: Statistical and graphing practices in JEAB, 1992-2017. Journal of the Experimental Analysis of Behavior, 111(2), 155-165. https://doi.org/10.1002/jeab.509
- Ledgerwood, D. M., Alessi, S. M., Hanson, T., Godley, M. D., & Petry, N. M. (2008). Contingency management for attendance to group substance abuse treatment administered by clinicians in community clinics. Journal of Applied Behavior Analysis, 41(4), 517-526. https://doi.org/10.1901/jaba.2008.41-517
- Lenoir, C., Hinman, J. M., Yi, Z., & Dixon, M. R. (2022). Further examination of the Children’s Psychological Flexibility Questionnaire (CPFQ): Convergent validity and age appropriateness. Advances in Neurodevelopmental Disorders, 6(2), 224-233. https://doi.org/10.1007/s41252-022-00259-5
- Levy, S., Siebold, A., Vaidya, J., Truchon, M.-M., Dettmering, J., & Mittelman, C. (2022). A look in the mirror: How the field of behavior analysis can become anti-racist. Behavior Analysis in Practice, 15(4), 1112-1125. https://doi.org/10.1007/s40617-021-00630-3
- Li, A., Gravina, N., Pritchard, J. K., & Poling, A. (2019). The gender pay gap for behavior analysis faculty. Behavior Analysis in Practice, 12(4), 743-746. https://doi.org/10.1007/s40617-019-00347-4
- Lovelace, T. S., Comis, M. P., Tabb, J. M., & Oshokoya, O. E. (2022). Missing from the narrative: A seven-decade scoping review of the inclusion of Black autistic women and girls in autism research. Behavior Analysis in Practice, 15(4), 1093-1105. https://doi.org/10.1007/s40617-021-00654-9
- Mathur, S. K., & Rodriguez, K. A. (2022). Cultural responsiveness curriculum for behavior analysts: A meaningful step toward social justice. Behavior Analysis in Practice, 15(4), 1023-1031. https://doi.org/10.1007/s40617-021-00579-3
- Matson, J. L., & Konst, M. J. (2014). Early intervention for autism: Who provides treatment and in what settings. Research in Autism Spectrum Disorders, 8(11), 1585-1590. https://doi.org/10.1016/j.rasd.2014.08.007
- May, B. K., & St. Cyr, J. (2021). The impact of the PEAK curriculum on standardized measures of intelligence: A systems level randomized control trial. Advances in Neurodevelopmental Disorders, 5, 245-255. https://doi.org/10.1007/s41252-021-00199-6
- Mayer, G., Sulzer‐Azaroff, B., & Wallace, M. D. (2019). Behavior analysis for lasting change. Sloan Publishing.
- McGill, O., & Robinson, A. (2021). “Recalling hidden harms”: Autistic experiences of childhood Applied Behavioural Analysis (ABA). Advances in Autism, 7(4), 269-282. https://doi.org/10.1108/AIA-04-2020-0025
- Morris, C., Goetz, D. B., & Gabriele-Black, K. (2021). The treatment of LGBTQ+ individuals in behavior-analytic publications: A historical review. Behavior Analysis in Practice, 14(4), 1179-1190. https://doi.org/10.1007/s40617-020-00546-4
- Nighbor, T. D., Zvorsky, I., Kurti, A. N., Skelly, J. M., Bickel, W. K., Reed, D. D., Naudé, G. P., & Higgins, S. T. (2019). Examining interrelationships between the Cigarette Purchase Task and delay discounting among pregnant women. Journal of the Experimental Analysis of Behavior, 111(3), 405-415. https://doi.org/10.1002/jeab.499
- Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
- Perone, M. (1999). Statistical inference in behavior analysis: Experimental control is better. The Behavior Analyst, 22(2), 109-116. https://doi.org/10.1007/BF03391988
- Plantiveau, C., Dounavi, K., & Virués-Ortega, J. (2018). High levels of burnout among early-career board-certified behavior analysts with low collegial support in the work environment. European Journal of Behavior Analysis, 19(2), 195-207. https://doi.org/10.1080/15021149.2018.1438339
- Pritchett, M., Ala’i-Rosales, S., Cruz, A. R., & Cihon, T. M. (2022). Social justice is the spirit and aim of an applied science of human behavior: Moving from colonial to participatory research practices. Behavior Analysis in Practice, 15(4), 1074-1092. https://doi.org/10.1007/s40617-021-00591-7
- Sanders, K., Staubitz, J., Juárez, A. P., Marler, S., Browning, W., McDonnell, E., Altstein, L., Macklin, E. A., & Warren, Z. (2020). Addressing challenging behavior during hospitalizations for children with autism: A pilot applied behavior analysis randomized controlled trial. Autism Research, 13(7), 1072-1078.
- Schulz, K. F., Altman, D. G., Moher, D., & the, C. G. (2010). CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. Trials, 11(1), 32. https://doi.org/10.1186/1745-6215-11-32
- Sevon, M. A. (2022). Schooling while Black: Analyzing the racial school discipline crisis for behavior analyst. Behavior Analysis in Practice, 15(4), 1247-1253. https://doi.org/10.1007/s40617-022-00695-8
- Shea, P., Johnson, P., & Togade, D. (2022). Using relational frame theory to examine racial prejudice: A tool for educators and an appeal for future research. Behavior Analysis in Practice. https://doi.org/10.1007/s40617-022-00767-9
- Sidman, M. (1960). Tactics of scientific research: Evaluating experimental data in psychology. Basic Books.
- Silverman, K., Wong, C. J., Needham, M., Diemer, K. N., Knealing, T., Crone-Todd, D., ... & Kolodner, K. (2007). A randomized trial of employment-based reinforcement of cocaine abstinence in injection drug users. Journal of applied behavior analysis, 40(3), 387-410.
- Skinner, B. F. (1956). A case history in scientific method. American psychologist, 11, 221-233. https://doi.org/10.1037/h0047662
- Sutton, A., Pikula, A., Yi, Z., & Dixon, M. R. (2022). Evaluating the convergent validity of the PEAK Comprehensive Assessment (PCA): Intelligence, behavior challenges, and autism symptom severity. Journal of Developmental and Physical Disabilities, 34(4), 549-570. https://doi.org/10.1007/s10882-021-09814-9
- Thrailkill, E. A., DeSarno, M., & Higgins, S. T. (2022). Intersections between environmental reward availability, loss aversion, and delay discounting as potential risk factors for cigarette smoking and other substance use. Preventive Medicine, 165, 107270. https://doi.org/10.1016/j.ypmed.2022.107270
- Twohig, M. P., Shoenberger, D., & Hayes, S. C. (2007). A preliminary investigation of acceptance and commitment therapy as a treatment for marijuana dependence in adults. Journal of Applied Behavior Analysis, 40(4), 619-632. https://doi.org/10.1901/jaba.2007.619-632
- United States of America Department of Defense. (2021). The Department of Defence comprehensive autism care demonstration auunal report 2021. https://health.mil/Reference-Center/Reports/2021/12/03/Annual-Report-on-Autism-Care-Demonstration-Program-for-FY-21
- Waasdorp, T. E., Bradshaw, C. P., & Leaf, P. J. (2012). The Impact of schoolwide positive behavioral interventions and supports on bullying and peer rejection: A randomized controlled effectiveness trial. Archives of Pediatrics & Adolescent Medicine, 166(2), 149-156. https://doi.org/10.1001/archpediatrics.2011.755
- Wang, Y., Kang, S., Ramirez, J., & Tarbox, J. (2019). Multilingual diversity in the field of applied behavior analysis and autism: A brief review and discussion of future directions. Behavior Analysis in Practice, 12(4), 795-804. https://doi.org/10.1007/s40617-019-00382-1
- World Health Organization. (2020). Doing what matters in time of stress: An illustrated guide. https://www.who.int/publications/i/item/9789240003927
- Wright, P. I. (2019). Cultural humility in the practice of applied behavior analysis. Behavior Analysis in Practice, 12(4), 805-809. https://doi.org/10.1007/s40617-019-00343-8
- Yi, Z., & Dixon, M. R. (2021). Developing and enhancing adherence to a telehealth ABA parent training curriculum for caregivers of children with autism. Behavior Analysis in Practice, 14(1), 58-74. https://doi.org/10.1007/s40617-020-00464-5
Affiliations
Downloads
How to Cite
- [ ACM ]
- [ ACS ]
- [ APA ]
- [ ABNT ]
- [ Chicago ]
- [ Harvard ]
- [ IEEE ]
- [ MLA ]
- [ Turabian ]
- [ Vancouver ]