Scoring Self-Study Quizzes Online, an IF-AT Model

Here’s my progress in a Stanford Online course:

The problem is that I didn’t really try on this. I just hit answers till I got it right, and it let me try again. I’ve been through online courses like this before — when the week gets heavy with other obligations the click-itis begins. You don’t learn, because you stop anticipating whether you are right, you stop investing yourself in the question. Expectation failure can’t happen because you stop expecting.

However, there’s a more elegant solution to this sort of stuff. It comes from some traditional techniques associated with IF-AT cards.

The way it works is this — on a 4 answer multiple choice question you get 5 points if your first guess is correct, 2 points if your second guess is correct, and one point if your third guess is correct. Zero points for getting it last.

I don’t have hard data handy on the learning impact of the technique, but I can tell you from direct observation that it radically changes student behavior. Students that shrugged off second and third guesses suddenly become very involved in the process. ┬áRather than going by gut instinct, they carefully think over their line of reasoning before taking the second guess.

The key, of course, is the diminishing returns — the fear of diminishing returns makes them think it over carefully, while the partial credit incentivizes them to keep going forward.

I’ve used these structures in my class, especially with team-based decisions, and I’m always amazed how it transforms detached students into highly engaged students, almost instantly. It’s one of those neat magic tricks that Project-Based Learning folks know about and most of the rest of the world doesn’t

Anyway — this is something that has annoyed me for a while about online quizzes (not just Stanford Online). I wish someone would implement a system like this, for my sake as an educator, instructional designer, and most especially, as a student.

About these ads

3 Comments on “Scoring Self-Study Quizzes Online, an IF-AT Model”

  1. Cameron says:

    Check out “Adaptive Mode” in Moodle quizzes.

  2. mikecaulfield says:

    Thanks! (This is why I love the internet!)

  3. Jared Stein says:

    Cameron beat me to it! I’ve not found anything quite like Moodle’s “adaptive” quizzing feature since.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 136 other followers