Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
installation:echo_state_networks [2019/11/11 03:44]
admin created
installation:echo_state_networks [2020/09/09 16:46] (current)
admin
Line 1: Line 1:
-===== Echo State Networks ====== +===== Echo State Network ====== 
-the sonification of an analog neural network+the sonification of the computing process in an analog neural network, 2019
  
  
 +The first song a computer intoned was in the 1970s when an IBM 704 at the Bell Labs sang‘ Daisy Bell’. The same song was sung by the artificial intelligence HAL-9000 in the film  “2001: A Space Odyssey” by Stanley Kubrick.\\
 +But why should an AI sang human songs?\\
 +Won’t they prefer their own beats and melodies?\\
 +The sonic structures produced by the eternal oscillation of analog neural networks is the more possible soundtrack when the technological singularity is reached and AI takes over. At that point in the future, when technology becomes uncontrollable - like the mathematischen John von Neumann predicted in the 1950s - the remains of the human civilization will probably listen to some kind of “Echo State Network”
  
-Can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen and sees these sound and pattern – and all that in a feedback loop+<html> 
 +<div align="center"> 
 +<iframe src="https://player.vimeo.com/video/455977563?title=0&byline=0&portrait=0" width="640" height="360" frameborder="0" allow="autoplay; fullscreen" allowfullscreen></iframe> 
 +</div> 
 +</html>
  
-At the core of the light and sound installation “Echo State Network” by Wolfgang Spahn there will be an artificial analog neural network that will generate sound. 
  
-The artist Wolfgang Spahn created an analogue neuron as part of his analogue computer "Confetti". More than 100 of the Confetti Neurons will build an analog version of a so called “Echo State Network”. That is a particular kind of model of a recurrent neural network. At it‘s core is a complex and back coupling neural network, similar to a Liquid-State Machine.+The installation raises the question: can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen to these sound and pattern, too and feeds this information back into the network?
  
-The input layer of that network will have sound and light sensors that react on brightness and different frequencies. These information will be processed in the Echo State Network and than outputted with a layer of firing neuronsTo make this phenomena hear able 8 speaker will amplifier the action in the network on 8 different nodes.+At the core of the sound installation “Echo State Network” by Wolfgang Spahn is an artificial analog neural network that generates sonic pattern and audible structures. The circuit of the neuron is an adaption of an early neural model originally designed by Japanese mathematician Shun'ichi Amari to explain the human heart beatsThus the factor time and feedback are added to the network. Compared to Facebook and Google networks this neural systems is much more complex and manifold in its appearance. One can say this analog artificial network mirrors far more the chaotic human nature than the digital AI implementations.
  
 +{{ :installation:echo_state_network_181216.jpg?600 |}}
 +
 +As part of his [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:analog_computer_main|Analog Computer Confetti]] the artist created an analogue electric circuit that mimic a model of a neuron. More than 150 of the [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:confetti501_confetti_neuron|Confetti Neurons]]  will form an analogue version of a so called “Echo State Network”. And because the model for that neuron was developed to explain our heart beat this network will oscillate, pulse and create most complex pattern one can see and listen to.
 +
 +{{ :installation:echo_state_networks_loop2019_03.jpg?600 |}}
 +
 +An Echo State Network is a particular kind of model of a recurrent neural network. At it‘s core is a complex, chaotic and back coupling neural network, similar to a Liquid-State Machine. At the networks input layer a couple of sensors will react to sound and light. Brightness and frequencies will be processed and fed back in the Echo State Network. A couple of firing neurons that oscillates in a audible frequency will form the output layer. Indicator LEDs shows the action in the network as well as 8 speakers make these activity hearable at 8 different nodes of the network. Thus the visitor can witness the activity in the neural network and can get an idea of the complexity of these processes.
 +
 +{{ :installation:echo_state_networks_loop2019_02.jpg?600 |}}\\
 +<html>
 +<iframe width="100%" height="166" scrolling="no" frameborder="no" allow="autoplay" src="https://w.soundcloud.com/player/?url=https%3A//api.soundcloud.com/tracks/849690328&color=%23a4a19c&auto_play=false&hide_related=false&show_comments=true&show_user=true&show_reposts=false&show_teaser=true"></iframe><div style="font-size: 10px; color: #cccccc;line-break: anywhere;word-break: normal;overflow: hidden;white-space: nowrap;text-overflow: ellipsis; font-family: Interstate,Lucida Grande,Lucida Sans Unicode,Lucida Sans,Garuda,Verdana,Tahoma,sans-serif;font-weight: 100;"><a href="https://soundcloud.com/wolfgang-spahn" title="Wolfgang Spahn" target="_blank" style="color: #cccccc; text-decoration: none;">Wolfgang Spahn</a> · <a href="https://soundcloud.com/wolfgang-spahn/echo-state-network-alt-space-loop-seoul" title="Echo State Network @ Alt Space Loop, Seoul" target="_blank" style="color: #cccccc; text-decoration: none;">Echo State Network @ Alt Space Loop, Seoul</a>
 +</div>
 +</html>
 +
 +"Echo State Network" was shown at [[http://altspaceloop.com/exhibitions/echochamber-sfxseoul2019|Alt-Space Loop]] as part of the exhibition [[http://www.sfxseoul.org/2019/|Sound Effects Seoul]] Korea, 2019.\\
 +With support of [[https://www.goethe.de/ins/kr/de/index.html|Goethe Institute Korea]].\\
 +
 +... and many thanks to Martin Kuentz for helping to solder one million neurons.\\



Wolfgang Spahn is a visual & sound artist based in Berlin. His work includes installations, performances of light & sound and miniature-slide-paintings. His art explores the field of analogue and digital media and focuses on both their contradiction and their correlation.
He is faculty member of the Sound Studies and Sonic Arts, Berlin University of the Arts.

Katalog Kybersonor_2022_DE
Portfolio_Wolfgang Spahn DE
Portfolio_Wolfgang Spahn EN


OPEN HARD- & SOFT-WARE

Here is most of the hard- and software the artist developed for his artwork.
DER NULLEFFEKT
PAPER-PCB
- Analog Computer
- Pop Neuron
- Paper-Duino
- Paper Synthesizer
- Paper Bits
- Raspberry Pi Hats
- VGA Synthesizer
- Sound Boards
ART COOPERATION

TEACHING

Miscellaneous

Old Web-Side
In Progress


Credits
Contact

Except where otherwise noted.
© 2018-22 Wolfgang Spahn. All Rights Reserved.