8 Hours to Better Supervision: BST, IOA, and Feedback Systems for BCBAs
- Jamie P
- Nov 28, 2025
- 8 min read
The 8-hour supervisor training is more than a checkbox on your way to mentoring trainees—it’s your chance to install a repeatable system for shaping competent behavior analysts. When done well, those eight hours translate into fewer fires, stronger client outcomes, and a team that learns quickly without burning out. When done poorly, you get the opposite: lopsided fieldwork logs, vague feedback, and notes that won’t stand up to review.
This practical guide turns the 8 hours into a competency-based playbook built on three pillars:
BST (Behavior Skills Training): model → rehearse → feedback → mastery
IOA (Interobserver Agreement) & Fidelity: make performance visible and reliable
Feedback Systems: short, predictable loops that improve behavior every week
What the 8-Hour Supervisor Training Is and Isn’t
What it is: A foundation in how to set up supervision that is ethical, goal-directed, documented, and tied to measurable skill growth. The official curriculum outline emphasizes structure: roles and expectations, goal setting, performance monitoring, ethics, diversity and cultural responsiveness, documentation, and evaluation.
What it isn’t: A one-time webinar that magically turns you into a great mentor. The eight hours should launch a supervision system you’ll run weekly—brief, tight, and relentlessly focused on client benefit and supervisee growth.
Success signals:
You and your supervisee can both point to 3–5 named competencies in progress (e.g., “designing a two-page BIP,” “running a 10-minute BST cycle,” “graph annotation & decision rationale”).
Your supervision minutes match meaningful work (unrestricted tasks, real analyses, plan writing, coaching)—not just talk.
IOA and fidelity checks are scheduled and visible to both of you.
When an auditor looks at your documentation, it’s boringly clean and obviously tied to outcomes.
The 8-Hour, Session-by-Session Agenda You Can Run This Week
Think of the eight hours as four 2-hour blocks (or eight 1-hour blocks) that each end with a concrete artifact. Every block uses BST so supervisees leave with a skill, not just notes.
Block 1 (2 hours): Set the Rails—Agreement, Scope, and Goals
Outcomes:
A signed supervision agreement spelling out cadence, competencies, boundaries, and escalation paths.
A shortlist of 3 competencies for the next 60 days (e.g., FBA brief, two-page BIP, 10-minute BST).
Ethics priming on assent/dignity, least-intrusive effective intervention, documentation.
BST focus: Model how to write a clear goal (behavior + condition + criterion). Rehearse by drafting one together and swapping roles.
Deliverables:
Supervision Agreement (1 page)
60-Day Competency Plan (1 page)
Block 2 (2 hours): BST on BST—Teach the Teaching
Outcomes:
Supervisee can run a 10-minute BST cycle with an RBT/teacher/caregiver on one routine (e.g., prompt fading during a request).
They can write a brief BST script (model lines, prompts, praise points, and a mastery check).
BST focus (meta!): You model the BST script; supervisee rehearses delivering it; you give feedback; then a quick re-probe.
Deliverables:
BST Script (half-page)
Micro-fidelity checklist for the target routine (2–3 look-fors)
Block 3 (2 hours): Data That Drive Decisions—Graphing, IOA, and Fidelity
Outcomes:
Supervisee can convert a week of raw data into a readable graph with phase lines and annotations for context (illness, schedule changes).
They can run at least one IOA snapshot correctly and compute agreement.
They can score a fidelity probe using the 2–3 look-fors you wrote in Block 2.
BST focus: You model the graph build and an IOA calculation; supervisee builds a second graph and runs a mock IOA; you give feedback, then they redo until fluent.
Deliverables:
One de-identified graph with annotations
IOA and Fidelity Snapshot (single-page sheet)
Block 4 (2 hours): Feedback Systems, Documentation, and Decision Logs
Outcomes:
Supervisee can deliver brief, behavior-anchored feedback (two “keeps,” one “change,” a follow-up probe).
Supervisee writes a session note that stands alone (purpose, procedures/context, data/interpretation, decision/rationale, safety/consent).
Supervisee starts a Decision Log (5–7 sentences) for non-routine events (assent withdrawn, safety escalations, plan changes).
BST focus: You model the feedback script; supervisee rehearses; you probe quality. Then you model a crisp note and decision memo; they write one and you mark it up.
Deliverables:
Feedback Script (one paragraph)
Session Note Template (five boxes)
Decision Log (with one complete entry)
How to Run BST Like a Pro and Avoid the Time Sink
Use real routines and live materials: Teaching “in general” wastes time. Anchor BST to a specific, high-value routine your supervisee is already running this week.
Keep models short: A great model is under two minutes. Narrate only what matters (“Watch how I deliver reinforcement within five seconds when the independent mand occurs.”)
Rehearse immediately with an observable criterion: “Run three trials with <2 prompts each” beats “Do it again.”
Feedback is a sandwich you don’t eat: Two concrete “keeps,” one concise “change,” then a probe. No monologues.
Stop when the criterion is met: Mastery today > 30 more minutes of theory.
IOA & Fidelity: The Levers That Make Supervision Measurable
Why it matters: Without IOA and fidelity, you can’t tell if a plan is implemented as designed—or if data reflect real change. Your supervisee needs to learn both sides: how to collect and how to audit.
IOA you’ll actually use weekly:
Total count IOA for discrete behaviors/events
Trial-by-trial IOA for correct/incorrect responding
Interval-by-interval IOA for duration-heavy routines (with caution about insensitivity)
Fidelity that fits the routine: Keep it to 2–3 look-fors, not 12. Example for FCT during homework:
Provides prompt hierarchy as planned (≤ level 2 average)
Delivers reinforcement per schedule within 5s
Honors assent; pauses when signals emerge; re-enters per protocol
Make it visible: Build a one-page template with:
Date, routine, observer(s)
Data target + IOA method, calculation space
2–3 fidelity items with Yes/No and comments
Decision line: “Continue / Tweak / Pivot” with a one-sentence rationale
Feedback Systems: Short Loops Beat Long Lectures
The loop you’ll run every week (30–40 minutes total, often split across days):
Pre-brief (10 min)
“Today we’ll watch transitions into seatwork. Look-fors: prompt hierarchy ≤ level 2; reinforcement within 5s. You’ll flag any assent signals.”
Observe (15–20 min)
Cameras or screen share where approved; otherwise in-person. Stick to the look-fors.
Feedback (5–7 min)
Keep 1: “Your reinforcement timing was on point 6/7 trials.”
Keep 2: “You honored assent twice and re-entered smoothly.”
Change 1: “On Trials 3–4, prompting drifted to level 3—let’s aim ≤ level 2. Let’s probe three trials right now.”
Probe (3–5 min)
Run it immediately if possible; otherwise schedule within 48 hours.
Document (2–3 min)
One‐paragraph log: look-fors, what happened, next probe. Drop a copy into both your documentation and the supervisee’s portfolio folder.
Cadence is king. A tight, predictable loop beats monthly marathons. Your supervisee should expect this rhythm.
Remote & Hybrid Supervision: Make the Distance Disappear
Consent & privacy first: If any part of supervision happens remotely, confirm informed consent for telepractice, the secure platform you’ll use, what’s recorded (if anything), and the pause/terminate plan for safety or dignity concerns.
Tele-friendly adaptations that work:
Bluetooth/earbud coaching for in-the-moment cues when allowed; otherwise use chat with pre-agreed shorthand (“R+ now,” “fade,” “pause”).
Short observation bursts (5–7 minutes) stitched across the week rather than one long block.
Screen-share graph reviews with live annotation of phase changes and context tags.
Fidelity at a distance: Use timestamped, 2–3 item rubrics. Consider self-monitoring checklists your supervisee completes and you verify periodically with IOA.
Documentation That Protects Clients and You
Your records should make an auditor yawn—in the best way. Use a five-box session note and a Decision Log:
Five-box note template:
Purpose: “Coach prompt fading during independent seatwork.”
Procedures & Context: “Pre-correction at bell; choice of first task; level-2 prompts available.”
Data & Interpretation: “Independent mands: 5 → 9; refusals: 4 → 1; trend improving with shorter latencies.”
Decision & Rationale: “Decrease prompts to level 1 for first two trials next session; least-intrusive path given stable trend.”
Safety/Consent: “Assent signal observed once; paused; re-entered per plan.”
Decision Log (5–7 sentences):
Situation and choice point (e.g., elopement during tele-coaching).
Options considered and least-intrusive effective choice.
How you honored assent and protected dignity/safety.
Fade/monitor plan and when you’ll re-evaluate.
This level of clarity helps teams follow the plan and keeps your supervision aligned with ethical standards.
Calibrating Across Supervisors If You Lead a Team
Run a monthly, 30-minute calibration. Each supervisor brings:
One de-identified graph with annotations
One fidelity rubric (2–3 look-fors)
One decision memo
What you do:
Score two example notes against the five-box template; discuss differences until 90% agreement.
Align on look-for definitions (what counts as “reinforcement within 5s”?).
Capture one improvement (e.g., “Add assent line to all rubrics”), ship it as policy, and update templates.
Result: Clients get consistent care; supervisees get consistent expectations; documentation gets easier.
Avoid These Supervision Pitfalls: Here’s What to Do Instead
Pitfall: Hour-chasing without competencies.
Do this: Track artifacts (FBA briefs, BIPs, graphs, BST scripts) alongside minutes. Minutes are necessary; artifacts prove growth.
Pitfall: Feedback monologues.
Do this: Two “keeps,” one “change,” one probe—done.
Pitfall: 12-item fidelity rubrics nobody uses.
Do this: Pick 2–3 look-fors that matter most for the routine.
Pitfall: Tele-supervision with no safety plan.
Do this: Confirm consent, contacts, pause criteria, and re-entry steps before the first remote observation.
Pitfall: Graphs without context.
Do this: Annotate illness, schedule changes, staff shifts. It prevents false “plateau” stories and guides better decisions.
A 30–60–90 Rollout Plan So It Sticks After the 8 Hours
Days 1–30: Foundations
Run Blocks 1–2.
Ship Supervision Agreement, 60-Day Competency Plan, BST script, 2–3 look-for rubric.
Start the Decision Log.
Schedule weekly pre-brief/observe/feedback blocks.
Days 31–60: Measurement Muscle
Run Block 3.
Require a weekly graph from each supervisee and one IOA snapshot every two weeks.
Begin a shared library of de-identified exemplars (graphs, notes, memos).
Days 61–90: Culture & Calibration
Run Block 4.
Start monthly supervisor calibration (notes, rubrics, decision memos).
Ship one small policy upgrade (e.g., “Assent line added to all plans; pause criteria standardized”).
Audit 10% of notes for five-box completeness and give brief, reinforcing feedback to supervisors who model excellence.
Example Artifacts
BST Script (example for prompting a help request):
Model: “I’ll show you: place work, wait 5s, prompt ‘Help, please,’ honor, and praise.”
Rehearsal: “Your turn—three trials.”
Feedback: “Keep: you honored independent help within 3s. Keep: clear praise. Change: fade to gestural prompt on trial 3.”
Probe: “Run 3 more trials at or below prompt level 2.”
2–3 Look-Fors (FCT during homework):
Acknowledges independent mand within 5s (Y/N)
Delivers reinforcement per schedule (Y/N)
Prompt level ≤ 2 on average (Y/N)
IOA Snapshot (trial-by-trial):
Total agreements: 27; disagreements: 3 → IOA = 90%
Five-Box Note (completed example):
Purpose: Increase independent requesting during seatwork
Procedures/Context: Pre-correction, choice of first task, prompts available to level 2
Data/Interpretation: Mands ↑ from 4 → 8; refusals ↓ from 5 → 2; steady improving trend
Decision/Rationale: Fade prompts to level 1 first two trials next session; least-intrusive effective change
Safety/Consent: Assent maintained; no risk events
Coaching for Ethical Judgment Built into Every Block
Ethics is not a separate module; it’s embedded in every skill:
Assent & dignity: Add an assent checklist to your rubrics; rehearse “pause” language in BST.
Least-intrusive effective: Require a fade plan in every BIP draft; probe it in supervision.
Scope & consultation: Normalize “phone-a-friend” consults for unfamiliar topographies or settings.
Transparent documentation: Decision Logs capture the why, not just the what.
When supervisees practice these in tiny, weekly reps, ethical judgment becomes automatic.
Final Word: Make the Eight Hours a Launchpad
The 8-hour supervisor training should kick off a living system—not conclude it. If you leave your training with a working supervision agreement, a BST habit, small IOA/fidelity tools, a feedback loop that takes 10 minutes, and a five-box note template, you’ve already beaten 90% of the friction supervisors face. Keep the loops short, the rubrics tight, and the wins visible. Your supervisees will grow faster—and your clients will feel the difference.
About OpsArmy
OpsArmy is a global operations partner that helps businesses scale by providing expert remote talent and managed support across HR, finance, marketing, and operations. We specialize in streamlining processes, reducing overhead, and giving companies access to trained professionals who can manage everything from recruiting and bookkeeping to outreach and customer support. By combining human expertise with technology, OpsArmy delivers cost-effective, reliable, and flexible solutions that free up leaders to focus on growth while ensuring their back-office and operational needs run smoothly.
Learn more at: https://operationsarmy.com
Comments