When information is cheap

You found an explanation. How would you tell whether you understand it?

Week 1 · A self-guided lesson

How to use this lesson

Read at your own pace; no presenter is needed. Allow around 30 minutes. Have somewhere to write a few short answers.

At a Pause and write slide, attempt the question before advancing. The next slide explains the reasoning so you can compare it with yours.

You need no networking background, working router, or AI account. All situations are fictional.

The situation: connected, but offline

Your laptop is connected to your home Wi-Fi. Yet a website will not load.

You search for an explanation and find: “A Wi-Fi connection does not guarantee internet access.”

The sentence sounds helpful. But could you explain why it is true? And what would convince someone else that you understand it?

First, understand the distinction

Wi-Fi provides a wireless connection to a local network. At home, the Wi-Fi access point is often built into the router.

Internet access also requires a working route beyond that local network. Being connected locally does not establish that the whole route works.

A website failing to load alone does not identify which part failed.

Technical background: Microsoft, “Fix Wi-Fi connection issues in Windows”; Cloudflare, “What is a router?” Links at the end.

A simple way to explain it

Think of two parts of the journey: reaching your home network, then reaching an external service.

The first part can work while the second does not. For example, the home Wi-Fi equipment may remain on during an internet-provider outage.

This is a simplified explanation of how the situation is possible. It is not a diagnosis of your laptop.

Now become the examiner

An examiner is someone deciding what another person’s performance demonstrates. In this course, you will practise making that judgement.

Imagine Sam reads the explanation and repeats: “Wi-Fi and internet access are different.”

You heard a relevant sentence. Should you conclude that Sam understands the difference? Keep that question separate from whether the sentence itself is correct.

What you saw; what you concluded

An observation describes something you could record: “Sam repeated the distinction while the explanation was visible.”

An inference is a conclusion drawn from that observation: “Sam understands why local connectivity can work without internet access.”

The inference goes beyond the observation. To defend it, we need to consider other ways Sam could have produced the same sentence.

Why one answer leaves uncertainty

Sam might understand the two parts of the connection and have used the source to check the wording.

Sam might instead have repeated the sentence without understanding what “local network” means.

Both possibilities fit what we observed. This does not show that Sam lacks understanding. It shows that our evidence does not yet distinguish the possibilities.

Why an explanation can feel enough

Familiarity means something feels recognisable or easy to follow. Reading a clear explanation can create that feeling before you have tried using the idea yourself.

Make It Stick cautions against treating ease and familiarity as reliable signs of learning. Our application: “That makes sense” is a starting point for investigation, not a final judgement.

Brown, Roediger & McDaniel (2014), Make It Stick, chapter 1. Remembering and understanding are not interchangeable.

Pause and write · 2 minutes

A fictional internet-provider outage interrupts the home’s connection to the internet. The home router and its Wi-Fi access point stay powered on.

Could a laptop still be connected to that Wi-Fi network? Why?

Write two sentences. You may revisit the explanation. Record whether you did; consulting it is permitted. Advance when you have an answer.

Worked response: separate the parts

Yes, the laptop could remain connected to the local Wi-Fi network even though the onward internet connection is interrupted.

This follows from the distinction between the local connection and the route beyond it. Losing one does not necessarily remove the other.

If you wrote only “yes,” your conclusion may be correct, but a reader still cannot see why you chose it.

What your answer demonstrates

An explanation linking the outage to the two parts of the connection gives us more to inspect than a repeated sentence.

If you consulted the notes, describe your answer as produced with the notes available. That condition matters; it does not invalidate the work.

This one answer still cannot establish that you can diagnose an unfamiliar real network fault.

Why not simply remove the source?

Removing the explanation could help us ask what someone can produce without it. But it also adds a demand on memory.

Suppose the job is to help someone interpret a support article accurately. Reading and checking the article belong to that task.

Before changing the resources, decide what ability you want to examine. Otherwise, you may test something different from what you intended.

A useful challenge from a reading

Clark and Chalmers argue in “The Extended Mind” that external resources can participate in cognition: the activity of thinking need not be explained solely by what happens inside a person.

For us, this raises a question: when someone works competently with a reference, why exclude that reference from the assessment?

Clark & Chalmers (1998), §§1–3. This is a philosophical argument, not proof that every assisted answer demonstrates understanding.

Make the claim match the task

Task A: explain the Wi-Fi distinction with a support article available. Success offers evidence about interpreting and using that article.

Task B: explain the distinction without consulting it. Success offers evidence about producing that explanation unaided at that moment.

Neither result automatically establishes broad networking expertise. State what was demonstrated, with which resources, rather than awarding a general label.

Choose a question for a reason

We want to know whether Sam can use the distinction, rather than merely repeat it.

A useful follow-up changes the situation: “Another device can load that same website on the same Wi-Fi. Does that prove the laptop is broken?”

This asks Sam to consider what the new evidence rules out and what remains possible. A harder vocabulary question would not necessarily help.

Pause and write · 3 minutes

Assume the other device loads the same website freshly at the same time, using the same home Wi-Fi. Its mobile data is off.

Does that prove the laptop’s hardware is broken? Write your answer and a reason. Then name one further observation you would want.

Keep the reference available. We are examining reasoning under that condition, not testing recall.

Worked response: a narrower conclusion

No. The successful device shows that the website is reachable through this home connection for at least one device at that time.

It does not identify the laptop’s fault. Its browser or network configuration might be involved; hardware failure is only one possibility.

Checking another browser on the laptop could help narrow the question. This is a reasoning example, not a complete troubleshooting procedure.

Two uncertainties to keep separate

About the network: we still do not know exactly why the laptop failed to load the page.

About Sam: if Sam explains why the new evidence is insufficient, we have observed reasoning about this case. We have not established how Sam would handle every other case.

The network problem supplies our example. The course’s central question is how we judge the person’s understanding.

Keep a short evidence record

Write three sentences about the answer you just produced:

  1. Observation: “With the notes available, I answered…”
  2. Interpretation: “This supports the claim that I can…”
  3. Limit: “It does not yet show that I can…”

A useful limit is specific: “identify the actual fault” or “explain this without notes.” “I might be wrong” does not identify the missing evidence.

Compare with this example record

Observation: Sam rejected the hardware diagnosis and named another possible explanation, while consulting the notes.

Interpretation: Sam used the supplied distinction to explain why this evidence does not identify a hardware fault.

Limit: The answer does not establish independent diagnosis. Sam may also have developed the explanation during the question itself.

What to take from Week 1

A useful answer and an understanding claim are different things. To connect them, examine how the answer was produced and what else could explain it.

Resources can support competent work. Record their contribution instead of assuming that assistance either proves or disproves understanding.

Next week asks whether a fluent explanation gives us enough evidence—or another reason to judge too quickly.

Read further: learning and cognition

Brown, Roediger & McDaniel (2014). Make It Stick, chapter 1. Ask why ease can mislead a learner. Author resources.

Clark & Chalmers (1998). “The Extended Mind,” Analysis 58(1), 7–19, §§1–3. Ask when an external resource belongs inside the activity. Read the paper.

These readings deepen the lesson; you can complete the activities without buying a book.

Sources and your next step

Technical background: Microsoft: Wi-Fi connection issues and Cloudflare: What is a router?

Sam and the scenarios are fictional teaching examples, not reported research results.

For the complete written activity and a record to keep, open the Week 1 investigation. The lecture notes offer a continuous reading version.