A checkable base for research
Formal Lean 4 proofs for the classical Hopfield network show how we check research code.
Bio-inspired network research
A line of research into bio-inspired neural networks: spiking networks and local learning. The code is open (PyPI 0.8.0) and is not used in products.
Almost all applied AI today is built on large models that someone else trained. We want to understand other approaches too: what networks closer to biological ones can do, where their limits are and which of it can be checked.
Working on top of someone else’s model does not explain how networks themselves work. How a network’s structure can form as it runs is still an open question. So we describe observable properties and engineering maturity, and make no claim that this approach beats existing ones.
What we show here is engineering maturity; there is no scientific result yet. For the classical Hopfield network, Lean 4 proves that its energy does not increase when neurons update one at a time. These proofs do not cover the TextBrain spiking network. There is also observable behaviour: the network recovers a stored pattern from a corrupted input. We make no claims about speed or text-generation quality: on the evaluation bench the spiking network does not yet beat a simple bigram model.
Formal Lean 4 proofs for the classical Hopfield network show how we check research code.
A direction we pursue to understand the field. It is not sold as a product.
It is proved that the energy of the classical Hopfield network does not increase when neurons update one at a time. This is a classical result, formalised anew: the proofs do not cover the TextBrain spiking network. We show that the proofs build.
Reproduce: lake build
Observable behaviour of the memory on a corrupted input. Behaviour only, with no claims about effectiveness.
Reproduce: pytest -k pattern_memory
The code is open, so everything above can be checked in the repository. Open the code ↗
The AVA calculator works out whether automating a process pays off, on your figures, with no form and no price from us. If it does not pay off, it says so.
Estimate the paybackDescribe it in your own words. If it cannot be solved or will not pay off, we will tell you before any work starts.