Yasuhiro Sakamoto (DE) - Sound Sculptures as Embodiment of Cross-modal Gesamtgestalt

Prague - December 7, 2012

Yasuhiro Sakamoto presents his paper within the panel Time and Technology at International conference MutaMorphosis in Prague, Czech Republic.

This paper will present the sound sculpture “Visible Canon: String Quartet without human beings” (2012) by Yasuhiro Sakamoto and Iñigo Giner Miranda. Within the bildwissenschaftliche and neuro-aesthetical framework of the work it explores aspects of uncertainty and embodiment in the process of perception. In addition, it touches upon the uncertainty of audio-visual perception as well as the workings of psychological time.

It is well known that a cross-modal perception of auditory and visual stimuli does not equal a mere summation of individual auditory and visual perceptions. As with the Gesamtgestalt of the perceptual mechanism, sounds are not apprehended individually, but shaped as a Tongestalt, in which auditory and visual stimuli are combined audio-visually, similarly to the perception of auditory apparent motion.

In recent scientific research, audio-visual perception has been usually conceptualised in relation to synaesthesia. However, the notion of synaesthesia refers to individual nerve structures, which do not encompass the implications of Gesamtgestalt. In fact, the latter describes a selective sensory property within the perceptual process, which can be observed in every human being. Recent neurobiological studies seem to underline the universality or non-individuality of cross modal perception. Therefore, we are looking for an alternative hypothesis that explains what happens, when auditory and visual stimuli are perceived at once.

Naturally, it is easy to conduct a perceptual study that records what is shown [input] on the one hand and what is perceived

  • Breda Bizjak (HR/SI)
  • Nikola Uzunovski (MK)
  • Nataša Bodrožić (HR)
  • Architecture of sound/Sound of architecture
  • Martin Reiche (DE)
  • Julien Bayle (FR)
  • Janez Križaj (SI)
  • NIKOLA UZUNOVSKI (mk)
  • JULIEN BAYLE (fr)
  • BOJANA PETKOVIĆ (rs)
  • Druga godba and ArtistTalk
  • CHARLEMAGNE PALESTINE (us)
  • Andrea Centazzo (us)
  • ArtisttTalk presents ANDREA CENTAZZO (us)
  • Martin Messier (ca)
  • Nils Frahm (de) – Interview at Dimensions Festival 2014
  • Juuso Koponen (fi)
  • Marco Steinberg (fi)
  • Heikki Rajasalo (fi)
  • Lauri Repokari (fi)
  • Lauri Repokari (fi)
  • Kalevi Ekman (fi)
  • Kalevi Ekman (fi)
  • Jan Vormann (de)
  • Nik Nowak (de)
  • Gabey Tjon A Tham (nl)
  • Katja Perat (si)
  • Jason Lescalleet (us)
  • Shigeto (us)
  • Azahara Cerezo (es)
  • Hrvoje Hiršl (cr)
  • Markus Jeschaunig (at)
  • Régine Debatty (be)
  • Sabin Bors (ro)
  • Szilvia Nagy (hu)
  • Cecile Babiole (FR)
  • Erkki Huhtamo – #2
  • Erkki Huhtamo – #1
  • Kera Nagel and André Aspelmeier (DE)
  • Amelia Andersdotter (se)
  • Markus Schmidt
  • Anouk Wipprecht (nl)
  • Johannes Grenzfurthner (at)
  • KairUS
  • Emanuel Andel (au)
  • Simon Katan (uk)
  • David Veneman (nl)
  • Trevor Jackson (uk)
  • Maja Milos (sr)
  • Mark Van Hoen (us)
  • Tiago Martins (pt)
  • Gabey Tjon A Tham (nl) and Oli Sorenson (us)
  • Gurvinder Singh (in)
  • Jens Barth (de)
  • Herman Kolgen (ca)
  • Ulay (de)
  • Khavn de la Cruz (ph)
  • Peter Tomaž Dobrila (si)
  • LA Vampires (US)
  • Daedelus (US) Artist Talk
  • Joanna Hogg (UK)
  • ArtistTalk Best Interview Award 2012
  • ArtistTalk Best Interview Award – Honorable mention!
  • ArtistTalk Best Interview Award- Honorable mention!
  • ArtistTalk Besti Interview Award – Honorable mention!
  • Piotr Jaros #2
  • Piotr Jaros #1
  • Marek Wasilewski, Dominik Lejman #2
  • Marek Wasilewski, Dominik Lejman #1
  • Liliana Orbach
  • ArtistTalk Best Interview Award Winner!
  • MoTA EDITIONS 1: CONVERSATIONS WITH ARTISTS
  • Markus Kison (DE)
  • Roel Smeets (NL)
  • Lorenz Potthast (DE)
  • Antoni Abad (ES)
  • Nina Czegledy (HU)
  • Attila Nemes (HU)
  • Robert Wechsler (US)
  • Jalila Essaïdi (NL)
  • Vera Penz (at)
  • Mike Rijnierse (nl)
  • Floris Kaayk (nl)
  • Maša Jazbec (si)
  • Oli Sorenson (us)
  • Gabey Tjon a Tham (nl)
  • Remco Schuurbiers (nl)
  • Arjon Dunnewind (NL)
  • Maria Joao Grade Godinho (UK)
  • Laura Beloff (FI)
  • Karol Radziszewski – #2
  • VALIE EXPORT (AT)
  • Paweł Janicki (PL)
  • Jane Grant (UK)
  • Varvara Guljajeva (ET)
  • Benjamin Pothier (FR)
  • THE DIGITAL NOW – Look up in the sky!
  • Kathy High (US)
  • Monika Bakke (PL)
  • Monika Weiss (US)
  • Mushon Zer-Aviv (IL) & Galia Offri (IL)
  • Adam Zaretsky (US) & Tony Allard (US)
  • Jennifer Kanary (NL)
  • Aleksander Valjamae (EE)
  • ARTIST TALK SYMPOSIUM @ ENTER 6
  • Mirko Tobias Schäfer (NL)
  • Susanne Jaschko (DE)
  • Špela Petrič (SI) & Robertina Šebjanič (SI)
  • Howard Boland (UK)
  • Alexander Cetkovic (UK)
  • Georg Tremmel (JP) & Shiho Fukuhara (JP)
  • Georg Tremmel (JP)
  • Elise Morin and Clémence Eliard (fr)
  • Anarchy Dance Theatre (tw)
  • James Price (UK)
  • Brian Degger (UK), Maria Joao Grade Godinho (UK), Melissa L. Caldwell (US)
  • Tyng Shiuh Yap (AU)
  • Tincuta Heinzel (RO)
  • Kevin Cole (UK)
  • John Paul (UK)
  • Verena Friedrich (DE)
  • Joanna Hoffmann (PL)
  • Oron Catts (AU) & Ionat Zurr (AU)
  • Mike Phillips (UK)
  • Yasuhiro Sakamoto (DE)
  • Sabine Himmelsbach (CH) – #2
  • Martin Hoorweg (nl)
  • Jacek Zachodny (PL) – #2
  • Jacek Zachodny (PL) – #1
  • Jan Jongert (nl)
  • Jan Korbes + Denis Oudendijk (nl)
  • Markus Bader (de)
  • David Szanto (ca)
  • Caro Verbeek (nl)
  • Cretien van Campen (nl)
  • Joost Rekveld (nl)
  • Chris Salter (us/ca/qc)
  • Harry Webers (nl)
  • John Hennequin (nl)
  • Daan Roosegaarde (nl)
  • Rob Bouwman (nl)
  • Art / Technology / Industry
  • Oliver Baurhenn (de)
  • Esther Venrooy (nl)
  • Dick Rijken (nl)
  • Eric Kluitenberg (nl)
  • Fennesz (at)
  • Lillevan (de) in conversation with Alexei Monroe (uk)
  • Ellen Sebring (US)
  • Ludger Pfanz (DE)
  • Daniel Belasco Rogers (DE) & Sophia New (DE)
  • Gretta Louw (DE)
  • Zack Denfeld & Cat Kramer (US)
  • Marc Dusseiller (CH)
  • Aleksander Valjamae (EE)
  • Peter Anders (US)
  • Roy Ascott (UK)
  • Marko Suvajdzic (RS)
  • Espen Gangvik (NO)
  • Blanka Earhart (US)
  • Paul Sermon (UK)
  • Marco Bischof (CH)
  • James K. Gimzewski (UK)
  • Clemens M. Plank (AT)
  • Mannes Poel (NL)
  • Mauri Kaipainen (FI)
  • Sabine Himmelsbach (CH) – #1
  • Ivana Sremcevic, Nenad Kesic (RS)
  • FELD (DE)
  • Teresa Almeida, Paulo Gouveia (PT)
  • Suzanne Anker (US)
  • Marcel·lí Antúnez Roca (ES)
  • Ekmel Ertan (TR)
  • Lech Twardowski (PL)
  • Petr Svárovský (CZ)
  • Roc Parés Burguès (ES)
  • Encore Heureux (FR)
  • Lenka Dolanová (CZ)
  • Maja Smerkar (SI)
  • Daniel Schwarz (DE)
  • Ingrid Diac (RO)
  • Marko Tkalčič (SI)
  • Nathan Brock (US)
  • Ulrich Fischer (SUI)
  • Ed Tannenbaum (US)
  • Irina Botea (RO)
  • Boris Vitázek (SK)
  • Rasa Smite (LV)
  • Don Foresta (FR/US)
  • Nathan Brock (US)
  • Ariane Labed (fr)
  • Niklas Roy (DE)
  • Niklas Roy (DE)
  • Pierre Jodlowski (FR)
  • Alessandro Ludovico (IT)
  • Robert Glashüttner (AT)
  • Kurt Fleckenstein (DE)
  • Zbigniew Rybczyński (PL)
  • Piotr Bosacki (PL)
  • Megan Daalder (USA)
  • Megan Daalder (USA)
  • Noriko Yamaguchi (JP)
  • Pierre-Luc Vaillancourt (CA)
  • Zbig Rybczyński (PL)
  • Jaś Domicz (PL)
  • Piotr Bosacki (PL)
  • Aki Nakazawa (JP/DE)
  • David Bowen (USA)
  • Paweł Janicki (PL)
  • Piotr Bosacki (PL)
  • ArtistTalk Best Interview Award!
  • Izabella Gustowska (PL)
  • Nina Kraviz (RU)
  • Daniel Miller (UK)
  • Richie Hawtin (CA)
  • Michael Nyman (UK)
  • Mostly Robot
  • Harun Farocki (CZ)
  • Eyal Sivan (IL)
  • Joachim Koester (DK)
  • Wolfgang Bittner (at)
  • Macular (nl)
  • Repetition, and Rebellion – Multiplicity in Spanish Emerging Art
  • Philippe Franck
  • Vytautas Michelkevičius
  • Philippe Franck
  • Angel F with parents Salvatore Iaconesi and Oriana Persico
  • Thorsten S. Wiedemann
  • Tapio Mäkelä
  • Melinda Sipos
  • JB
  • Andy Holtin
  • Mladen Bundalo
  • Igor Bošnjak
  • Ernest Truely
  • François Duconseille
  • Simon Krahl
  • Gregor Kamnikar
  • Sally Golding
  • Kevin Bartoli
  • Alex Toland
  • on the other. If the results are clear, it may be explained how they are perceived [process] as well. However, it is not as easy to explain why they are perceived in a specific manner. There is certainly a “rule” of perception such as Gesamtgestalt, yet, it remains unfathomable as long as we observe human perception in relation to the time of physical world alone. At this point, the sciences encounter a certain limit to its applicability to the investigation of the psychophysical sensory properties within audio-visual perception.

    In the case of motion, perception follows a horizontal timeline according to the physical continuity of motion. However, sound features a physical continuity as well: It moves both on the horizontal and the vertical timeline. While listening to music, the audience follows automatically, but the brain perceives the structure of music congruently in temporal and constitutive in non-temporal. Also, each sounds, articulation, melody and rhythm are is perceived in relation to a prior and consequent element of the same structure. This, in turn, indicates that during the experience of music our senses enter another world, where present, past and future coexist simultaneously, which further complicates our understanding of audio-visual perception and the ruling mechanism behind it.

    All of this leads to the question of how to figure the Gesamtgestalt of perception. In our approach we focus on the cutting point of audio-visual perception and try to embody a cross-modal Gesamtgestalt that links sound (=tone) and vision (=motion) in the perceptual process. In this context, the art-machine “Visible Canon” is conceived of as an experimental device for the exploration of audio-visual perception.

    The machine looks like a rolling ball structure that plays music and works like a three-dimensional chart. It plays three tracks of various Canons, including Johan Pachelbel’s Canon, and displays the kinetic movement of an iron ball at the same time. Through the combination of the auditory and the visual structure of the canon the uncertainty and complementary relation of the stimuli calls up the Gesamtgestalt of audio-visual perception.

    In the case of Pachelbel’s Canon, it might be less important to envision its structure visually and kinetically at the same time, since it will be perceived automatically as rhythm and melody. However, if a Canon has a more complicated composition, rhythm and melody cannot be followed as easily; in the process, the visual information provides the viewing audience with a powerful key to the understanding the underlying structure of the Canon on the basis of the cross-modal Gesamtgestalt.

    With the above method we endeavour to embody the Gesamtgestalt of audio-visual perception. At the same time we have explored the new role of art in modern sciences that provides an experimental device able to overcome the shortcomings of the classical methods.

    Yasuhiro Sakamoto (DE) Yasuhiro Sakamoto (DE) 2 Yasuhiro Sakamoto (DE) 3 Yasuhiro Sakamoto (DE) 4 Yasuhiro Sakamoto (DE) 5 Yasuhiro Sakamoto (DE) 6

    Related links:


     


     
     

    0 Comments

    You can be the first one to leave a comment.

    Leave a Comment