60-Second Marker Spot-Check Run Sheet

1. The Audit Philosophy: Why Markers Don’t Listen to 400 Speeches

The most common fear among teaching teams is workload: “I have 400 students; I cannot listen to 800 audio/video files.”

You are not grading oral presentations. The objective questions in Section 2 are auto-graded by Moodle. The oral bookends serve as an authorship audit and identity validation gate.

Markers evaluate oral bookends in 45 to 60 seconds per paper using a targeted triage model:

• Routine Verification: Marker spot-checks 10% to 15% of submissions at random.
• Targeted Audits: Marker prioritizes papers where:
  • The student scored in the top 10% but finished in unusually rapid time.
  • The student sits right on a critical grade boundary (48%–51% Pass, or 83%–85% HD).
  • System telemetry (e.g. browser focus loss or rapid clicking) flagged the attempt.

---

2. The 60-Second Spot-Check Protocol

Follow this exact 3-step sequence when opening a student’s attempt in Moodle Quiz grading:

[ STEP 1: JUMP TO QUESTION 01 (First 5 Seconds) ]
Check Video: Did the student perform the physical gesture?
(e.g., pen across chin, paper over face, touch collar)
                │
                ├── NO ──► FLAG: Mark Red Light (Hold paper)
                │
                └── YES ─► PASS: Identity confirmed. Proceed to Step 2.
                                │
                                ▼
[ STEP 2: GLANCE AT QUESTION 98 (Brainstorm Notes, 5 Seconds) ]
Is there a short, rough, bullet-point outline — or is it empty / a
perfectly formatted paragraph that reads like an LLM's output?
                │
                ├── Rough bullet points, matches the topic   ─► Continue to Step 3
                │
                └── Empty box, OR polished full-paragraph text ─► FLAG: Check AI verdict
                                                                card on the review page
                                │
                                ▼
[ STEP 3: JUMP TO QUESTION 99 (Listen to Middle 30 Seconds) ]
Fast-forward 15 seconds into the audio/video.
Listen for conversational thinking vs scripted reading, and confirm
it tracks with the Question 98 notes (not a mismatched topic).
                │
                ├── Authentic Speech (Pauses, everyday words, refers to concepts) ──► GREEN LIGHT
                ├── Polished Script Read (Monotone, eyes reading off-screen)     ──► AMBER LIGHT
                └── Foreign Terms / Completely off-topic / Refusal to explain    ──► RED LIGHT
                                │
                                ▼
[ STEP 4: COPY FEEDBACK TEMPLATE & SAVE (15 Seconds) ]

Tip: Don’t do the Question 98 cross-check manually for every attempt — the async AI evaluator (evaluate_attempt task) already runs this comparison automatically, alongside cohort-relative timing z-scores and obscure-distractor collusion markers, and surfaces anomalies as flags on the quizaccess_simpleproctor review page. Use the 60-second protocol above as the fast human sanity check on whatever the AI already flagged 🟢/🟡/🔴.

---

3. Quick-Decision Matrix

🟢 Green Light (Full Marks / Verified)

• What you see/hear: Physical gesture verified. Student stumbles naturally, pauses to think, explains their answer in conversational language, and cites course terminology accurately.
• Action: Award full marks for the verification component. Proceed to next student.

🟡 Amber Light (Developing / Scripted Read)

• What you see/hear: Physical gesture completed. However, the student’s delivery is monotone, eyes are visibly tracking a teleprompter or second screen, and the response consists of formal textbook definitions rather than explaining their own reasoning.
• Action: Deduct marks on the oral reflection component. Leave Template 2 feedback.

🔴 Red Light (Flagged / Audit Escalation)

• What you see/hear:
  • Physical gesture is completely missing or performed off-camera.
  • Audio is clearly desynchronized from video (potential deepfake or pre-recorded spoof).
  • Student refuses to explain their reasoning or reads completely foreign answers unrelated to the course.
• Action: Hold the grade. Flag the attempt for Unit Coordinator review. If determined to be technical error, issue a Moodle User Override for a fresh attempt under a new random question.

---

4. Copy-Paste Moodle Grading Feedback Templates

Keep these snippets ready to paste directly into the Moodle Quiz feedback comment box:

Template 1: Green Light (Pass)

Feedback: Verification complete. Your physical identity gesture was performed correctly. Your spoken response demonstrated clear conceptual ownership and conversational reasoning. Good job.

Template 2: Amber Light (Needs Improvement / Scripted)

Feedback: Physical verification step completed. However, your response relied heavily on reciting textbook definitions rather than explaining your reasoning in your own words. In future assessments, focus on speaking conversationally about your problem-solving choices rather than reading prepared scripts.

Template 3: Red Light (Flagged / Manual Audit)

Feedback: This attempt has been placed on academic hold because the mandatory physical verification gesture was missing from Question 01, or the audio response could not be verified. Please contact the Unit Coordinator to arrange an identity review or attempt reset.