Week 5: Rewards & Reinforcement

Two habits can get the exact same number of payoffs and still feel completely different to keep doing. This week is about why timing, not quantity, is what makes a reward hard to walk away from.

22 March 2027

Open the slides

This week’s question#

Imagine two people who each check for a new episode of a show six times, and each gets rewarded with “yes, it’s out” exactly twice. By any measure of quantity, they had identical experiences. Ask them how compelling it felt to keep checking, though, and the answers can be completely different. The number of rewards was never the variable that mattered — when they landed was.

Reliable versus unpredictable#

A reward that arrives on a fixed, learnable rhythm gets treated by the mind as basically solved: once the pattern is known, there’s no tension left in checking, because checking has stopped being informative. A reward that arrives on an irregular, unpredictable rhythm never resolves that way. Every single check stays genuinely informative — this could be the one — and that uncertainty is what keeps checking behaviour going long after a predictable schedule would have been abandoned as “solved.”

This is the same mechanism behind why refreshing a feed, checking for a notification, or re-opening an app “just in case” can feel compelling in a way that checking something on a known schedule (like a weekly episode release) usually doesn’t. The unpredictability isn’t a side effect of the reward being rare — it’s doing the actual psychological work, independent of how often the reward shows up.

A familiar scene#

Two habits, one person: checking the mail, which arrives at roughly the same time most days, and refreshing a social feed, which sometimes has something new after ten seconds and sometimes after twenty minutes. Nobody obsessively re-checks the mailbox once they’ve learned its schedule. Plenty of people re-check a feed dozens of times in an hour that yields the same average number of “new” moments the mailbox does in a week. The difference was never about how much reward showed up — it’s about not being able to predict when.

The interactive experiment: Two Checking Habits#

Below are two short rounds of the same task: press a button to check for a new episode. Both rounds hand out the exact same total number of “new episode” moments — watch for when they land, not how many there are.

What just happened?#

• The fixed schedule rewarded you on a perfectly regular rhythm — once the pattern became apparent, later checks stopped being genuinely uncertain.
• The variable schedule rewarded you the same total number of times, on an irregular rhythm that never resolved into a learnable pattern — every check stayed uncertain until the moment it landed.

Both patterns above were fixed in advance for this demonstration, not live random draws — they’re illustrative teaching patterns, not a real probability system. If checking felt more compelling, harder to stop, or more attention-grabbing during the variable round even though the total payoff was identical, that’s this week’s mechanism showing up directly: unpredictability, not quantity, is what keeps a checking habit alive.

What this demonstration can’t tell you: two six-check rounds from one visitor aren’t a controlled study, the rounds always ran in the same order, and one person’s reaction to two made-up patterns is not evidence about your own vulnerability to unpredictable rewards specifically. What repeated, controlled studies of reinforcement schedules (not this demo) actually show is that variable schedules sustain behaviour longer on average across many subjects — not that this round proved something stable about you personally.

Reflection#

Think of a habit you keep returning to that has an unpredictable payoff — checking something, refreshing something, hoping for a particular outcome. If that same payoff arrived on a totally predictable schedule instead, same total amount, would you still check as often? What does your honest answer say about which part was actually pulling you back?

Next episode#

This week was about why unpredictable rewards keep a single habit alive. It said nothing about how long any of that checking actually felt like it took while it was happening — that’s next episode’s question.