Week 12 Guided session: Project 3 Fresh-Load Audit and Submission
Reproduce the final specialist in a clean environment and submit one internally consistent evidence chain
17 May 2027 · Guided session
Estimated active time: 60 minutes · Release: Monday 17 May 2027 at 09:00 AET · Solution release: immediate submission checklist; no model solution.
Learning goals#
- reproduce the final specialist in a clean environment;
- rerun task, shifted-slice, and regression evaluation from frozen revisions; and
- submit one internally consistent evidence chain.
Preparation#
Freeze the candidate checkpoint, parser/verifier, decoding settings, and evaluation configuration. This session is an audit, not permission for an unplanned final sweep.
Activity#
- Create a fresh environment and load the exact HF revision using only documented files and commands.
- Run valid and invalid format edge cases, the primary metric, one shifted slice, and one retained-capability check.
- Reconcile parameter preflight, compute ledger, data/code/model revisions, checksums, and report tables.
- Confirm that the SlopU marking account can read the frozen private repository without receiving a token.
- Complete the
ass3_report.pdfand authenticated portal checklist; save the receipt after submission.
Expected output and self-check#
Retain the clean-environment log, final metric table, regression result, manifest, and receipt. The package is ready only if the report, code, model card, portal identifiers, and reproduced outputs all refer to the same frozen system.
The spec
What you bring to the session. Written so a reader can tell whether it has been met without asking you.
- the report, code, model card, portal identifiers, and reproduced outputs all refer to the same frozen system
Teaching team
- Dr Yiwei Easton — convenor