“Productive Failure”: A Teaching Method Which Leads to Short Term Failure, but Long Term Success

My parents would sometimes take me on drives in the countryside, with the intention of getting lost and finding their way back home. It always worked out fine with my dad at the wheel, but it seems that I did not inherit his good sense of direction, and given a choice, will tend to take the exit or fork in the road that takes me further away from home.

So I was that early-adopter nerd who was obsessively printing out MapQuest maps in both directions anytime I had a driving trip planned. And who to this day pops out of the subway in NYC looking like a slightly frantic whack-a-mole until I can figure out which direction is which.

Of course, the upside of getting lost a lot is that you discover new things and places that you otherwise would not have known existed. You learn more.

A similar phenomenon occurs in teaching. Or more specifically, in learning.

Traditionally, teaching looks something like this:

  1. Explain how to do something (lecture).
  2. Show them what it looks like (demonstration).
  3. Fix their off-target attempts, to help them get it right as quickly as possible, and reward them for their successes (feedback).

This sequence tends to emphasize getting to the correct answer as expeditiously as possible. It’s how our schools are often set up. It’s how many of us were taught. And it’s how we parent as well.

The tell-show-do model makes a lot of sense – and it works pretty efficiently. Yet there’s little room or time for exploration, floundering around in the dark, and discovery. And growing evidence suggests that the experience of being lost may actually facilitate a deeper grasp of the material in the long run – even though at first, it looks like a hot mess.

“Productive failure”

A pair of researchers conducted a study of “productive failure” to see if this method would lead to greater learning than the traditional teaching approach (“direct instruction”).

They took two 7th grade classrooms, and gave them a 30-minute, 9-question pretest to see how much they already knew about how to calculate average speed1.

But then their learning experience began to diverge.

Direct instruction

One class began learning about average speed with a lecture. The teacher explained the concepts, worked through some examples, encouraged questions, then had students solve practice problems. Then they went over the problems and discussed the solutions. For homework, they were assigned similar problems in their workbook.

The problems ranged from simple to moderate in difficulty, but were essentially plug-and-chug-type questions. Here’s an example:

Jack walks at an average speed of 4 km/hr for one hour. He then cycles 6 km at 12 km/hr. Find his average speed for the whole journey.

They repeated this lecture-practice/homework-feedback process for 7 class periods.

Pretty typical-sounding process, right?

Productive failure

The other class was split up into small groups, and each was tasked with solving two complex problems like below:

Hummingbirds are small birds that are known for their ability to hover in mid-air by rapidly flapping their wings. Each year they migrate approximately 9000 km from Canada to Chile and then back again. The Giant Hummingbird is the largest member of the hummingbird family, weighing 18-20 gm. It measures 23cm long and it flaps its wings between 70-80 times per minute. For every 18 hours of flying it requires 6 hours of rest. The Broad Tailed Hummingbird flaps its wings 100-125 times per minute. It is approximately 10- 11 cm long and weighs approximately 3-4 gm. For every 12 hours of flying it requires 12 hours of rest. If both birds can travel 1 km for every 550 wing flaps and they leave Canada at approximately the same time, which hummingbird will get to Chile first?

They were unleashed on these problems with no teacher support or guidance, but simply given two class periods to try to solve each problem (4 classes total). They were given no homework, but did have extra problems to work on individually after completing each of the group problems (2 class periods).

After 6 sessions of working on their own, the class spent their final class session sharing their work with the teacher and each other – their solutions, strategies, and approaches to solving the complex problems. It was only then, that the teacher finally explained how to approach and solve the problem the “correct” way and assisted the students in going back through the problems and arriving at the correct answer.

So all in all, they spent 7 class sessions learning how to calculate average speed, exactly like the direct instruction group.

Then, the posttest

Following the completion of the 7 classes, both classes took a 35-minute, 5-item post-test, which consisted of 3 simple problems (like the ones the direct instruction group worked on), 1 complex problem (like the one the productive failure group had to do), and one type of problem that neither of them had done (basically, answer the question and pick which graphic best represents the answer).

So…how’d they do?

If we’re talking about success in conventional terms – as in, can students learn how to solve relatively straightforward problems with a teacher’s guidance and feedback – then the results were pretty clear.

Based on homework scores, the direct instruction group averaged a score of 91.4% on their homework.

The productive failure group on the other hand, performed miserably on their unguided attempts to solve the complex problems, with only 2 out of the 12 groups (16%) arriving at the correct solutions. And when working on the individual problems, their average score was even worse (11.5%2).

But wait! A very different picture emerges when you look at the posttest scores.

Unlike the homework problems, which were pretty straightforward, the posttest included both simple and complex problems. And in both cases, the productive failure group outscored the direct instruction group by a significant margin.

On the simple problems, the productive failure group earned an average score of 84.8% (vs. 75.3% for the direct instruction group).

On the complex problem, the productive failure group earned an average score of 59.7% (vs. 42.4% for the direct instruction group).

Short term performance vs. long term learning

Students often ask for help before trying to solve problems on their own. And teachers are in turn accustomed to providing help (it’s certainly faster and more efficient in the short term to offer the right fix, technique, etc.), rather than withholding the right answer or strategy and letting the student struggle, searcher, and look in all the “wrong” places.

So in much the way that spaced, random, and variable practice lead to worse performance in the short term, but better performance in the long term, it seems that the goal of productive failure is not to get the correct answer via shallower learning (“unproductive success”), but instead, to cultivate a deeper understanding of the fundamental principles and various ways of arriving at a solution regardless of short-term performance.

Ownership

Furthermore, it seems that the productive failure approach also increases engagement in the learning process, at least exhibited by the following quotes from teachers involved in the study:

“I was not only surprised by the kinds of ideas and methods students developed to solve the problems but also their ownership of their ideas…I mean, during the consolidation, I could see that they really wanted to know why their methods did not work, or how someone else’s method was better, and how the “correct” way of solving the problem was better…”

“in our usual lessons, they simply accept what we tell them, our explanations and stuff, this is how to do it and they just take it…but here, they were not ready to just take our explanations so easily, they wanted to defend their ideas and not give up without a fight sort of…I mean, not a fight but you know there was this engagement in understanding why, why, why…”

Take action

How have you found ways of applying this concept to your teaching approach (or how could you, if not already)?

One example that comes to mind is fingerings and bowings. I remember one of my early formative teachers withholding fingering recommendations when I was still quite young, encouraging me to come up with some on my own.

I felt totally lost at the time, and the idea of having to pull fingerings seemingly out of thin air was completely foreign. I thought I was supposed to do whatever was printed in the music, or whatever she gave me. I felt lost for some time, and I came up with some pretty funky ones, but over the years, I came to take great pride in thinking up clever fingerings and bowings designed to enhance the music or make things easier to execute.

Additional reading

For more on the peril of being too helpful in lessons, here’s a great piece written by Robert Duke: Their Own Best Teachers: How We Help and Hinder the Development of Learners’ Independence @Music Educators Journal

Footnotes

  1. The classes’ scores were not significantly different from each other, and they were both taught by the same math teacher, so everyone started off on pretty even ground.
  2. Which I believe is an indicator of the percentage of students who were able to solve the extension questions correctly on their own, but I couldn’t tell for sure from the description in the study.

Ack! After Countless Hours of Practice,
Why Are Performances Still so Hit or Miss?

It’s not a talent issue. And that rush of adrenaline and emotional roller coaster you experience before performances is totally normal too.

Performing at the upper ranges of your ability under pressure is a unique skill – one that requires specific mental skills, and perhaps a few other tweaks in your approach to practicing too. Elite athletes have been learning these techniques for decades; if nerves and self-doubt have been recurring obstacles in your performances, I’d like to help you do the same.

Click below to learn more about Beyond Practicing – a home-study course where you’ll explore the 6 skills that are characteristic of top performers. And learn how you can develop these into strengths of your own. And begin to see tangible improvements in your playing that transfer to the stage.

Comments

8 Responses

  1. Reminds me of the concept that there is no such thing as a received truth. You either get the dirt under your nails digging it out of the ground on your own, or you don’t really grasp it. I think the fun of this process, and the fact that I know how well it works, is why I tend to be an autodidact.

  2. To be honest, my first conscious application of this concept was a long time coming, and quite primitive: shut up during lessons more than I talk. Let the student play through the whole piece first before commenting. I am embarrassed to remember how many years I taught before I really grasped this, and of course the urge to comment, correct, just plain TALK is still strong in me. (Better if it were The Force). But through my years of teaching I have sort of stumbled on this concept accidentally, and can verify it works amazingly — and of course I can see it in my own life experience too. Patience! and the ability to tolerate ‘errors’, fumbling, confusion, dead ends, etc are lessons for teaching, and for life.

  3. There are some lessons that cannot be put into words. They can only be understood subconsciously, through being felt. It’s like trying to define the color blue – beyond where it resides in the visible light spectrum, wavelength & frequency & all that, but at least anyone who isn’t colorblind to it can see & identify it right away. Very strange for something that technically has no definition.

    We also have our own styles. I’m trying to learn slap on bass guitar but it’s proving frustratingly elusive to me, and I’ve noticed that some players anchor and stay really close to the strings with their slapping hand while others float way above it. I definitely know one thing: The further away I float, the worse my aim becomes, even if I try to play by ear. You really can’t explain a style, even by showing it point-blank – it makes sense & feels right to the person using it, but the person being shown it must find his own way, not just because he will perceive different things to be comfortable but because humans simply cannot convey some types of information in any way (see above paragraph).

    It’s not about finding every variation of a problem-solving situation and making sure the student has memorized it, it’s just about accessing things on their simplest level – the Platonic level – and being able to go from there.

  4. Great post! I’m curious also about the role small group work might have had in the productive failure class. I feel like one of the weaknesses of my private lesson set up is that my students don’t get the fun of playing together – or of sharing learning in this way. Something to work on!

    I’m a fiddler and fiddle teacher, and it’s often frustrating to me when my students want one right answer when so often in fiddle playing there are many right answers, with the solutions a particular player utilizes being the foundation of their style. It’s a complex series of answers rather than a single simple one. I can definitely see some ways I can explore using this technique in my lessons – I’ve been brainstorming a list of questions and topics to try: bowings, melodic, harmonic, and rhythmic variations, ways to articulate or ornament a note… Basically, again and again asking our essential question as musicians – how do I make those sounds?

  5. This makes perfect sense, great post! Being told how to do something isn’t very effective, but coming to the answer on your own terms (with some guidance), is where real learning occurs. I try to keep this in mind, and instead of “telling”, I try to ask my students lots of questions. Like you say, sometimes the going is slower, but it means better long-term rewards!

  6. There has been a big debate in education regarding the effectiveness of discovery learning versus direct instruction, especially in mathematics. The main thing that strikes me is that the study referenced here may not be measuring what it is trying to measure. There are too many variables. The direct instruction might have just been bad. Also, they could have included some complex problems in the DI homework, but did not. Why were they left out? Basically, the DI group had no practice with complex problems. You get good at what you practice.

    I have seen students do both well and poorly in both types of classes. I can see how discovery learning could be more effective, but I think it is also more prone to total disaster in the classroom. I have never seen an entire direct instruction class bomb, but I have seen it with discovery learning. This could be because teachers are not adequately trained to facilitate discovery. It can be very tricky managing the group dynamics so that all students stay engaged. There are also ways to blend both types of learning, so it does not have to be either/or.

Leave a Reply

Your email address will not be published. Required fields are marked *

Get the (Free) Practice Hacks Guide

Learn the #1 thing that top practicers do differently, plus 7 other strategies for practice that sticks.

Do you know your mental strengths and weaknesses?

If performances have been frustratingly inconsistent, try the 4-min Mental Skills Audit. It won't tell you what Harry Potter character you are, but it will point you in the direction of some new practice hacks that could help you level up.

Share417
Tweet1
Email