Kiel Nano, Surface and Interface Science (KiNSIS)

Prof. Herbert Jäger (Jacobs University Bremen): An introduction to Reservoir Computing

12.06.2017 von 17:15 bis 18:45

Institut für Elektrotechnik und Informationstechnik, Geb. D, "Aquarium", Kaiserstr. 2, 24143 Kiel

Abstract

 

Recurrent neural networks (RNNs) are general approximators for nonlinear dynamical systems and have recently become widely used in the "deep learning" field of machine learning, especially for speech and language processing tasks. For instance, Google's speech recognition and language translation services are based on RNNs.

However, the deep learning set-ups for RNN training are computationally very expensive, require very large volumes of training data, and need high-precision numerical processing. For such reasons, deep-learning variants of RNNs are problematic in fields where training data are scarce, where fast and cheap algorithms are desired, or where noisy or low-precision hardware is to be used. This is often the case in domains of nonlinear signal processing, control, brain-machine interfacing, or biomedical signal processing.

Reservoir Computing (RC) is an alternative machine learning approach for RNNs which is in many aspects complementary to the ways of deep learning. In RC, a large, random, possibly low-precision and noisy RNN is used as a nonlinear excitable medium - called the "reservoir" - which is driven by an input signal. The reservoir itself is not adapted or trained. Instead, only a "readout" mechanism is trained, which assembles the desired output signal from the large variety of random, excited signals within the reservoir. This readout training is cheap - typically just a linear regression. RC has become a popular approach in research that aims at useful computations on the basis on unconventional hardware (non-digital, noisy, low-precision).

The talk gives an introduction to the basic principles and variants of RC. Numerous examples will be presented according to wishes from the audience.

Prof. Hermann Kohlstedt

Diesen Termin meinem iCal-Kalender hinzufügen

zurück

Medien

Veranstaltungen

Kalender

« Juni 2018 »
Mo Di Mi Do Fr Sa So
28 29
  • 16:15: Wires, trusses and pillars produced by assembly of plasma generated nanopartices (Prof. Dr. Ulf Helmersson, Linköping University, Schweden)
  • 16:15: Wires, trusses and pillars produced by assembly of plasma generated nanopartices (Prof. Dr. Ulf Helmersson, Linköping University, Schweden)
  • Klicken Sie, um Details zu allen 2 Terminen zu sehen.
30
  • ganztägig: Nanotechnology and Innovation in Baltic Sea Region 2018 (NIBS)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
31
  • ganztägig: Nanotechnology and Innovation in Baltic Sea Region 2018 (NIBS)
  • 17:00: Low-energy electron transport in water: Aerosol droplets, molecular clusters, and liquid bulk, Prof. Ruth Signorell (ETH Zürich)
  • Klicken Sie, um Details zu allen 2 Terminen zu sehen.
1
  • ganztägig: Nanotechnology and Innovation in Baltic Sea Region 2018 (NIBS)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
2 3
4
  • 16:00: Cells and tissue as active materials (Prof. Dr. Ulrich Schwarz, Heidelberg)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
5 6 7 8 9 10
11
  • ganztägig: Driven dynamics: non-statistical processes on the femtosecond time scale in simple organic molecules, Prof. Theis Sølling (Kopenhagen)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
12
  • 16:15: ICE CUBE and the Discovery of High-Energy Cosmic Neutrinos (Prof. Dr. Francis Halzen, University of Wisconsin)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
13 14
  • 17:00: Imidazolate Frameworks Potsdam and Hydrogen-bonded Supramolecular Networks, Prof. Dr. Hans-Jürgen Holdt (Universität Potsdam)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
15 16
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
17
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
18
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • 17:15: RF NEMS Magnetoelectric Sensors (Northeastern University, Boston)
  • Klicken Sie, um Details zu allen 2 Terminen zu sehen.
19
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
20
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
21
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
22
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
23
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
24
  • ganztägig: KiNSIS auf der kieler uni live 2018
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
25
  • 17:15: tba, Iain Dunlop, Imperial College London
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
26
  • 16:15: Particle Physics after the Higgs Discovery: Where do we go? (Prof. Dr. Thomas Mannel, Siegen)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
27 28
  • 17:00: Bioinformatics tools for understanding the biological role of carbohydrates, Prof. Frederique Lisacek (Universität Genf)
  • Klicken Sie, um Details zu allen 1 Terminen zu sehen.
29 30 1