These days I’m thinking about the silent rhythm stuff. We all have the experience that some pieces of music remind us of some particular scenes, we can imagine the picture in mind without watching a real image. Then what about the opposite? Could we imagine the sound when watching silent images or videos? Chaplin’s films give an example. Maybe the idea of “silent rhythm” is kind of off the topic and quite different from your live studies of AVE, I think it’s worth studying to better understand the relationship between audio and visual.
We know that sound is a vibration that propagates as a mechanical wave of pressure and displacement, through some medium. Imaging that we are in outer space, we can feel the vibration while sound cannot be heard because no air as medium. While we cannot hear sound doesn’t necessarily mean we cannot feel it. Some findings suggest that the experience deaf people have when ‘feeling’ music is similar to the experience other people have when hearing music. The perception of the musical vibrations by the deaf is likely every bit as real as the equivalent sounds, since they are ultimately processed in the same part of the brain.
For us normal persons, we already have a sound library that is built through our life experience. We know what the sound should be like when waves lapping the shore, ping-pongs bouncing on the floor, someone knocking the door…When these kinds of scenes appear on the screen we can imagine the sound even if the video itself is silent.
The video provided below is my work for silent rhythm. Sound is filtered, whereas the balls in the video are of strong rhythm and scenes switch frequently, both of which create a feeling of intensity. It’s interesting that the video is silent while you cannot feel any peace. Another option for performance is that live sound could be inserted in this video in a “on and off” form, that is, the sound stops time to time and when stopped the objects keep vibrating, audience may feel that the sound is still there because of auditory inertia (not sure whether this phase exists).
Softwares related: Cinema4D, AfterEffects, Photoshop.