The mixably Open Online Course (mOOC). Part I: Module Structure.

This is an off the cuff presentation of the module structure in the Psych course we are developing, which shows some of the possibilities of combining multiple OER into a course designed for institutional reuse. Part II will talk more about the mixability piece.

I started this project to in part show how easy this is for institutions to do. I found that is is not hard work, but it takes a *lot* of time to structure a semester’s worth of modules at this level. Accordingly, my impression of the value has shifted — I find it hard to imagine that a faculty member could find the time to build out something at this level on their own — and that’s a huge argument for open production and collaboration.

Are conversation and customization orthogonal? Some thoughts on the Rocketship Schools announcement.

Screen-shot-2011-05-03-at-11.50.05-AM-620x460Charter school company Rocketship’s current hybrid model seems like a decent enough idea — move from generalist to specialist teachers in grade school — specialists that understand learning issues in math and literacy at perhaps a deeper level. Adopt a 75/25 blend of classroom teaching with  learning lab activities that are adaptive — customized to their exact level of reading and math proficiency.

That sort of customization has long been the the great hope of educational technology, the solution to the two-sigma problem of mass education — a problem Bloom defined as the search for mass methods of teaching as effective as one-on-one tutoring.

Unfortunately, of the things that educational technology brings to bear on the two-sigma problem — conversation, customization, and feedback — customization has been the big tech disappointment. While newer entrants into the space may think video + feedback + branching logic is revolutionary, the method dates back at least to B.F. Skinner’s Programmed Learning. A decade later, Bloom’s Mastery Learning focused heavily on teaching that was customized to either the specific class or student. And the use of such methods is not an untested hypothesis: when I went to grade school back in the late 70s we had a programmed reading program, still around I think, called SRA that was based on skill-level customization and individual assessment and practice. This stuff has been around for a while, and tried on a large, national scale.

All of these efforts have had some effect in appropriate domains  Bloom’s Mastery Learning, for example, has shown effect sizes around 0.5 in recent meta-analyses. That’s not a bad effect size, but if you look in Hattie, it’s only marginally above the 0.4 cut-off that Hattie shows as the average effect size of *any* intervention.

Computers were supposed to change that by automating much of the work around customization. Starting in the 1960s, they began to do just that in some domains, such as flight simulation, chess instruction, and simple math problems. The idea was that as computers became more sophisticated they would be able to automate instruction in more subtle tasks. But that dream, to this day, has still not been realized. We have more computer power in our pocket than it took to stage the moon landing, and yet….

I admit to being a bit confused by this result. By all accounts, customization should work, and not just in limited domains like learning to play an instrument, but in all domains where there can be something such as “expert” knowledge. Yet, for some reason, it just doesn’t.

Back to Rocketship (you’d almost forgotten about them right?). Let’s look at that chart again:


Today, Rocketship announced it was backing away from it’s learning lab structure:

Rocketship Schools in the Bay Area have been one of the trailblazers in the ever-changing landscape of blended learning. Located in low-income neighborhoods, the schools’ Learning Labs — where students spend up to 90 minutes a day on computers working on math and literacy software — has been one of its defining characteristics.

But this model isn’t working, some Rocketship teachers say, and because it’s a charter school network with evolving systems, it may soon be changing, according to this PBS Newshour story.

First, let me congratulate Rocketship for being a charter that actually makes changes based on what is working and what is not. I’m not a huge charter school fan (I like the idea of magnet schools and universal admission better) but this is exactly what charter schools are supposed to do — pursue iterative improvement, not rigid ideology.

What’s more interesting to me, however, is why it is not working:

“There’s definitely an aspect of us kind of not knowing enough about what’s going on in learning lab to be able to use that in our classrooms,” said teacher Judy Lavi.

“We don’t yet get data that says, OK, teach this differently tomorrow because of what happened here. And that is — that is a frustration point,” said teacher Andrew Elliott-Chandler.

Adam Nadeau, principal of Rocketship Mosaic Elementary, says he doesn’t think the Learning Lab model will continue next year. And Elliott-Chandler sees a different function for the computers.

“Next year, we’re thinking of bringing the computers back to the classrooms and the kids back to the classrooms,” he said.

What’s fascinating about this is it suggests a reason why customization may not work the way we want it to in blended scenarios — it undermines the shared experience necessary to make good use of classroom time. Teachers can’t walk into a classroom and say — “OK, it looks like yesterday’s explanation of weighted averages didn’t really work given your scores, so here’s what we are going to do.” and launch an activity. They can’t do that because there is no single yesterday for the students. The data is there, presumably, but with everyone at a different spot, the data is useless. By the time enough students have gone through a module for the teacher to see the students have radically misconstrued a concept the majority of students have already carried that misconception forward into additional modules, and now everything is blown…

The solution they mention of bringing the lab into the classroom to monitor the students is not bad (although it will likely kill the cost savings investors were salivating over). Walking around, a teacher can get a sense of what the struggles are, and stage an impromptu discussion or activity. But what is most interesting is it represents a compromise on a scale consisting of two somewhat opposed principles at the poles: customization (the holy grail of educational technology) and conversation (its overlooked brother).

Indeed, structured classroom discussion has one of the highest effect sizes in Hattie, much higher than mastery learning. But it’s really difficult to have a classroom discussion (or group activities that foster student discussion) without some level of shared experience and knowledge. I’m curious if this fact might lie behind much of the surprising failure of computerized adaptive learning systems….

Random Username Generator & Magic FERPA Solution

I’m a firm believer in encouraging students use psuedonyms on the web, at least while they find their feet in social media. I wouldn’t want to be haunted by my freshman composition assignments for the rest of my life, and accordingly I don’t think it’s fair (or smart) to encourage freshmen to blog under their own name until they develop some sense of what they want their identity to look like long-term. (Some are ready earlier than others, but it must be a choice).

I generally encourage pseudonyms as a transitional step. This approach also keeps FERPA issues at bay. But the process of finding a usable name takes forever, and students end up choosing pseudonyms that generally are pretty traceable to them.

This Random Username Generator is a great way to have your students generate random names. Not only are the names it generates meaningful and memorable, but click one and it will run out and check its availability across a number of platforms.


You’ll still have to remind students to use good taste (I’m not sure the randomly generated “codpiececurry” is the best moniker, for example), but it should radically simplify those first steps for your students, keep their identities under their control, and provide a bit of fun in the process.

Prepping for the Wrong Future, Residential Online Edition

Cole points me via email to Tyler Cowen today, who continues to argue that what I’ve been calling “Residential Online” is indeed the future:

A large number of institutions in the top one hundred will move to a hybrid on-line model for a third or so of their classes and they will do so gradually, without seriously disrupting norms of conformity or eliminating campus life.

Agreed, absolutely. But I’m fascinated even more with this line:

Conformity pressures and signaling may militate against the “stay at home all day” forms of on-line education, but not against on-line education more generally, in fact quite the contrary.

Weirdly, almost nobody in the “Education is an MP3 crowd” or the “We’ll all be fine, it’s just churn” crowd gets this. People think the great threat to HE’s current business model is a fully online degree or a fully free degree. And quite rightly, most colleges laugh this off, because the conformity/signalling issues make sure that anyone going outside the normal signalling process takes a huge risk, especially relative to the time and opportunity cost of a degree.

Except a war with completely online outfits is not what’s coming. In reality the threat (if you want to call it a “threat”) is a cheaper, mostly online education. An education like that can be built out within months, plugs into the existing structure, and is indistinguishable (in terms of signalling) from a “normal” degree. For state schools, such change will likely be mandated by state legislatures and administration, either directly, or indirectly through trustee appointments and conditional funding. Such actions will only become more attractive to legislators as state budgets buckle under the weight of providing adequate medical care to the retiring Baby Boomers.

The real debate, then, will not be online vs. residential institutions, but over what sort of hybrid model residential institutions adopt. For example, I believe a model that allows for openness and cross-institutional collaboration is preferable to vendor-driven models, and that face-to-face extracurricular activities are central to our mission. Others disagree. I think that the model we move to has to support a wide variety parallel social missions universities have adopted over the years — others think these things should be unbundled. And these are not subtle differences, but ones that affect who we are as a larger society, what our capabilities will be, and what sort of experiences we value for our children.

My advice to anyone making decisions in higher education is to ignore the “Coming Tsunami” side of things, and build your own hybrid/blended model. One that stays true to what you think your mission is, and what you think is essential in education. Because those that don’t build credible models now will have models built elsewhere imposed on them in the near future, most probably by people with very different aims.