All Episodes

June 11, 2025 70 mins

Watching treatment implementation is one of the key determinants behind whether great treatments lead to great results. But, deep down in our hearts, we all struggle to hit that magic 33% of sessions with greater than 80% agreement we all learned about in graduate school. But, what if interobserver agreement didn’t have to be that. What if we were thinking about IOA all wrong? This week we brush up on some of the basics of IOA procedures like “How do I calculate IOA again?” before moving on to more interesting research in the field like training folks to take good IOA and questioning the standard wisdom of how much IOA is good enough. We’ll be watching you!

This episode is available for 1.0 LEARNING CEU.

Articles discussed this episode:

Hausman, N.L., Javed, N., Bednar, M.K., Guell, M., Schaller, E., Nevill, R.E., & Kahng, S. (2022). Interobserver agreement: A preliminary investigation into how much is enough? Journal of Applied Behavior Analysis, 55, 357-368. doi: 10.1002/jaba.811

Garrity, M.L., Luiselli, J.K., & McCollum, S.A. (2008). Effects of a supervisory intervention on assessment of interobserver agreement by educational service providers. Behavioral Interventions, 23, 105-112. doi: 10.1002/bin.258

Hartz, R.M., Gould, K., Harper, J.M., & Luiselli, J.K. (2020). Assessing interobserver agreement (IOA) with procedural integrity: Evaluation of training methods among classroom instructors. Child and Family Behavior Therapy, 43, 1-12. doi: 10.1080/00168890.2020.1848404

If you're interested in ordering CEs for listening to this episode, click here to go to the store page. You'll need to enter your name, BCBA #, and the two episode secret code words to complete the purchase. Email us at abainsidetrack@gmail.com for further assistance.

Mark as Played

Advertise With Us

Popular Podcasts

United States of Kennedy
Stuff You Should Know

Stuff You Should Know

If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.

Dateline NBC

Dateline NBC

Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com

Music, radio and podcasts, all free. Listen online or download the iHeart App.

Connect

© 2025 iHeartMedia, Inc.