Hacker News new | past | comments | ask | show | jobs | submit login
Scientists develop the next generation of reservoir computing (nature.com)
76 points by geox on Sept 22, 2021 | hide | past | favorite | 7 comments



Check out one of the early papers on this. Its one of my favourite titles:

http://dataphys.org/list/pattern-recognition-in-a-bucket/

There was a Science paper on RC recently too:

https://www.science.org/doi/10.1126/sciadv.abh0693


How similar is this to the reservoir computing work being done in Julia with ResevoirComputing.jl (part of the sciml ecosystem)?


Not just similar, the same. If you look through the documentation you'll see that https://github.com/SciML/ReservoirComputing.jl is a collection of reservoir architectures with high performance implementations, and some of our recent research has been pulling reservoir computing to the continuous domain for stiff ODEs (think of it almost like a neural ODE that you do not need to train via gradient descent): https://arxiv.org/abs/2010.04004 . We are definitely digging through this paper with some fascination and will incorporate a lot of its advancements (reservoir-free architectures) into the software.

For implementations of delay embeddings, you can already find it in DynamicalSystems.jl (https://juliadynamics.github.io/DynamicalSystems.jl/dev/embe...) in the Julia ecosystem, setup to compose with DifferentialEquations.jl. I think there are still a lot of big questions on using this in the continuous space though, so many next steps.


Awesome - my first thought was “hmm I wonder when the Julia community will implement something based on this” :)


What about Volterra kernel estimates? This is the particularly interesting thing in my opinion.


Karl Friston’s dynamic causal modeling approach in neuroimaging has been doing this Volterra kernel NVAR thing for years now. Interesting that it’s being used more broadly, but surprising to call it reservoir computing.


The next generation Magic 8-Ball should use reservoir computing + a GPT-3-like model of all human knowledge to perform speech recognition and display the most likely answer to spoken yes/no questions! ... "Reply hazy, try again."

Magic 8-Ball:

https://en.wikipedia.org/wiki/Magic_8-Ball

Role of non-linear data processing on speech recognition task in the framework of reservoir computing:

https://www.nature.com/articles/s41598-019-56991-x

When I asked my Magic-8 ball about which email client to use, it said: "Outlook not so good."




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: