I can’t remember if I’ve told this story here before or not, but the first time I played for Dr. Suzuki, he remarked that when his eyes were closed, I sounded great. But that when he opened his eyes, I sounded…not so great.
Indeed, although I hear I was a pretty rambunctious and chatty little kid, apparently, that part of me disappeared and turned into that guy from Ferris Bueller when I had a violin in my hands.
Of course, audition and screening tapes were audio-only back in those days, so it didn’t matter if I looked like Droopy Dog in those kinds of performances. But now that video is a thing, does that mean we have to worry about how we look in our screening videos, video performances, and livestreams too?
Like, how much do our facial expressions or body movements, and the visual aspect of our performance really matter? Does this have a measurable impact on the listener’s experience? Or are musicians’ ears finely-tuned enough to make accurate judgments about a performance without being overly influenced by the physical movements of the performer?
Three different recordings
A 2008 study (Juchniewicz) of 112 undergrad and grad music majors from six different universities takes a closer look at this question.
The researcher recruited a pianist with an active international performance and teaching career to create three recordings of the opening of Chopin’s Etude in E major, Opus 10 No. 3.
In one recording, the pianist performed with no body movement, where he was asked to limit his movement “to only those required to technically perform the piece.” Meaning, he could move his hands and arms, of course, but had to keep his head, the rest of his upper body, and even facial expression completely still.
In a second recording, he performed with head and facial movement, where he was allowed to now move his head and make facial expressions, in addition to whatever movements were “required to technically perform the piece.”
And in the third recording, he was allowed to use full body movement. That is to say, he was finally allowed to move freely and naturally, as he normally would in a performance of the piece.
But there’s a catch!
The catch, though, is that the pianist was actually filmed while playing along with a recording of Vladimir Ashkenazy performing the piece.
Well, to make sure that the quality or musicality of the performance remained consistent across videos, and the only difference was how the pianist looked, the researchers used Ashkenazy’s recording as the audio track for all three videos.
Four different ratings
The three clips were then presented to participants in random order, with the following prompt:
In the videotape you are about to see a pianist performing the Etude No. 3 in E major by Frederic Chopin. The pianist shown has entered a piano competition and is required to send in a videotape. He has asked for help in determining which of the three performances is the most musical. You will see and hear roughly 35 seconds of each take of the performance. Please fill out the questions asked for each performance while you watch the videotape.
After each video clip, the students were asked to rate four different aspects of the pianists’s performance, on a five-point scale (1=poor; 5=excellent).
Specifically, on the quality of the pianist’s 1) phrasing, 2) dynamics, 3) rubato, and 4) overall musicality of the performance.
So…technically, given that the audio was exactly the same in each video, the ratings of the three performances should have been exactly the same too. But would the pianist’s physical gestures and movements lead the listeners to experience the performance in different ways?
The impact of what we see on what we hear
Yep! The pianist’s body movements did indeed change the students’ perception of the performance.
The full body movement performance got the highest scores, and the highest overall musicality scores.
The head and facial movement performance got the next highest scores and second-highest overall musicality scores.
And the no movement video got the lowest scores.
In other words, the performance in which the pianist moved freely, with head movements, facial expressions, and physical gestures, came across as being a significantly higher-quality and more musical performance than identical performances, in which the pianist either moved less freely or not at all.
It’s not just about moving
On one hand, it seems kind of unfair to think that moving around more would create the impression of a better performance than one in which the performer sounds just as great when your eyes are closed, but seems a little lacking when your eyes are open. But on the other hand, it also makes total sense when you think about it.
I mean, intuitively, I think we know that we communicate quite a bit about our thoughts, our emotions, and our personality through our movements.
For instance, a conductor doesn’t just keep time by waving a stick in the air. They use the rest of their body, and facial expressions, to provide the orchestra with all sorts of other musical cues and directions, from mood and character and dynamics, to articulation, phrasing, and so on.
And it seems that the same is true of other musicians as well. For instance, studies of clarinetists and percussionists in an area of research known as “cross-modal sensory interactions”1) have found that physical movements communicate information about emotional tension and phrasing above and beyond what sound alone communicates. And that gestures can even affect things like listeners’ perceptions of how long a note is.
So what are we to take away from all of this?
A few clarifications
Well, first off, I think it’s important to clarify that this isn’t about moving for its own sake. Or a situation where more is better. Because I’m sure there’s a certain point at which movements no longer support the underlying musical message and are just distracting (case in point: the Elaine Benis dance).
And it’s not just yet another aspect of online performances that you now have to stress about, on top of making sure your internet connection is stable, your computer has enough free RAM available, you have the right camera and mic turned on, your levels are set, your lighting looks good, you’ve framed the shot, etc.
Your facial expressions and the way you move your body is just another tool you have at your disposal. A way to help you draw the listener in and communicate more fully what you want their experience to be. To emphasize what you want them to feel, in a way that audio can’t quite do by itself.
There are lots of reasons to do more recordings of yourself in the practice room, and today’s study suggests that it’s probably worth making sure at least some of these are video recordings too. And that when reviewing tape, it’s important to really use our eyes and not just our ears, to make sure the way we move actually supports what we are trying to say with the music.
Howard Nelson and Pamela Frank explain in their podcast episode that it’s important to watch a performance with the sound muted, when evaluating whether one is playing with excessive physical tension. This week’s study made me wonder if maybe that same strategy would work well for this too. Where you sing or audiate the piece in your head, while watching video of yourself playing, to see if your movements and gestures really do support – or detract from – your musical intentions.
Has motivation been a challenge for your students?
Speaking of videotaping and practicing, I’ve heard from many teachers (and have seen in my own kids’ experience) that it has been a real challenge to keep students motivated to practice, in the absence of the regular kinds of live performances or auditions they are accustomed to. And that many students have been experiencing even more nerves around taping, auditions, and performances, because there haven’t been as many opportunities to practice this skill and play in front of live audiences in the past year.
If that’s been your experience as well, and if adding a few new tools to your toolbox, and brainstorming ideas with a bunch of thoughtful, curious, supportive, like-minded educators sounds like it might be a fun way to start off the year, you may be interested in the upcoming series of live workshops I’m running in February. Specifically, February 11, 18, 25, and March 11 and 18.
I’ll show you how I present effective practice skills and strategies for managing nerves and getting into the zone to students in my classes. And there will be worksheets and activities you can “steal,” small and large-group mastermind sessions, Q&A’s, and perhaps a few random cat videos too. But all spread out in a manageable sort of way, so it doesn’t get too overwhelming.
Teachers who have participated in this workshop series have reported seeing some pretty cool changes in their students. Not just in terms of the level of their playing, but in their ability to experience a wee bit more joy and satisfaction in daily practice sessions as well.
If you’re a tiny bit intrigued, you can see what they’re saying, and get all the details here: Performance Psychology Essentials for Educators
Juchniewicz, J. (2008). The influence of physical movement on the perception of musical performance. Psychology of Music, 36(4), 417–427. https://doi.org/10.1177/0305735607086046