Online assessment best practices: a practical checklist
A good online assessment is valid (it measures what you intended), secure (it resists cheating without becoming hostile), accessible (every learner can take it fairly), and feedback-rich (takers learn from it). In practice that means aligning every question to a learning objective, using shuffling and time limits instead of surveillance, designing for screen readers and keyboard use, and showing explanations after submission. This guide turns those four pillars into a checklist you can run before publishing.
The four pillars of a good online assessment
Most assessment problems trace back to neglecting one of four things: validity, integrity, accessibility, or feedback. Strong assessments treat all four as design requirements, not afterthoughts. The rest of this guide takes each in turn and ends with a single pre-publish checklist.
Validity: does it measure what you think?
An assessment is valid when its score reflects the skill or knowledge you intended to test — not reading speed, test-taking tricks, or luck. Validity is mostly built at the question level.
- Align every question to a stated learning objective. If a question doesn't map to something you taught, cut it.
- Test one concept per question, so a wrong answer tells you exactly what the taker missed.
- Put the substance in the stem, not the options. The taker should understand what's being asked before reading the choices.
- Write plausible distractors that represent real misconceptions, not obvious throwaways.
- Match difficulty to purpose — a formative check should have gentler questions than a final exam.
- Cover the material proportionally so the assessment isn't dominated by one minor topic.
After the assessment runs, use per-question analytics to find broken items: a question everyone misses is usually flawed or untaught, and a question everyone aces may be too easy to be informative.
Security and integrity without surveillance
You can't make an online assessment cheat-proof, and aggressive proctoring often does more harm than good — it raises anxiety, creates accessibility problems, and still gets circumvented. Sensible friction beats surveillance for most stakes.
| Technique | What it does | Best for |
|---|---|---|
| Shuffle questions | Each taker sees a different order | Discouraging copying from a neighbor |
| Shuffle answer options | Position of the correct answer varies | Same — and prevents pattern memorization |
| Time limit | Less time to look answers up | Recall-based assessments |
| Question pools / variants | Different takers get different items | Higher-stakes tests |
| Limit retakes | Caps attempts at the answer key | Graded assessments |
| Open-book design | Questions that need reasoning, not lookup | When you can't prevent lookup anyway |
If you can't reliably stop people from looking answers up, stop trying — write the assessment as open-book. Application and reasoning questions that can't be answered with a quick search measure deeper understanding and sidestep the whole integrity arms race.
Match the integrity effort to the stakes. A low-stakes formative quiz needs almost none; a certification exam justifies shuffling, variants, time limits, and capped retakes.
Accessibility: a fair test for everyone
An assessment that some learners can't navigate isn't measuring knowledge — it's measuring access. Accessibility isn't optional polish; in many settings it's a legal requirement, and it's always the right call.
- Ensure it works with a screen reader and full keyboard navigation, with a clear focus order.
- Use sufficient color contrast and never rely on color alone to convey meaning.
- Add descriptive alt text for any image that carries information needed to answer.
- Write in plain, direct language and avoid unnecessary jargon or convoluted sentence structure.
- Make sure it's fully usable on phones and tablets, not just desktops.
- Offer extended time or flexible limits where accommodations require them.
- Don't make a strict timer the default if speed isn't part of what you're assessing.
A useful test: try taking your own assessment with the keyboard only, and again at a small screen size. The friction you hit is friction every learner with those needs hits too.
Feedback that teaches
An assessment that only returns a number wastes its best moment. The instant after someone answers — especially when they got it wrong — is the highest-attention teaching window you'll ever get.
- Attach an explanation to every question, not just the hard ones.
- Reveal correct answers after submission for formative assessments where learning is the goal.
- Make feedback specific — explain why the right answer is right and why a tempting wrong answer is wrong.
- Show a clear result and, where relevant, a pass/fail outcome so takers know where they stand.
- For low-stakes practice, allow retakes so takers can act on the feedback they just received.
A free tool like Formkii covers the mechanics that make this practical — auto-scoring, per-question explanations, a passing score, shuffling, and an optional timer — so you can focus on writing good questions and useful feedback rather than tallying scores.
The pre-publish checklist
- 1Every question maps to a learning objective; off-target questions cut
- 2One concept per question, substance in the stem, plausible distractors
- 3Integrity measures matched to stakes (shuffle, timer, variants, retake limits)
- 4Open-book reasoning questions used where lookup can't be prevented
- 5Screen-reader and keyboard navigable; good contrast; informative alt text
- 6Plain language; fully usable on mobile
- 7Accommodations (extra time / flexible limits) available where needed
- 8Explanations on every question; correct answers revealed for formative use
- 9You took it yourself cold and with the keyboard only — no surprises
Frequently asked questions
How do I prevent cheating on an online assessment?
Use proportionate friction rather than surveillance: shuffle questions and answer options, set a sensible time limit, use question variants for higher stakes, and limit retakes. When you can't prevent lookups anyway, write open-book reasoning questions that can't be answered with a quick search.
What makes an online assessment valid?
Validity means the score reflects the intended skill, not reading speed or luck. Achieve it by aligning every question to a learning objective, testing one concept per question, putting the substance in the stem, and writing distractors that represent real misconceptions.
How do I make an online assessment accessible?
Ensure it works with screen readers and keyboard navigation, use strong color contrast without relying on color alone, add alt text to informative images, write in plain language, and make it usable on mobile. Offer extended time where accommodations require it, and don't impose strict timers unless speed is part of what you're assessing.
Should online quizzes show correct answers and explanations?
For formative assessments where learning is the goal, yes — reveal correct answers and attach an explanation to every question, since the moment right after answering is the strongest teaching opportunity. For high-stakes tests where takers might retake the same items, you may hide the answer key.