Joscha Bach on GPT-3 https://www.youtube.com/watch?v=FMfA6i60WDA GPT-3 moves in a semantic space, masters relations between words, but can only deepfake understading

Joshua built the MicroPSI architecture based on PSI Theory https://en.wikipedia.org/wiki/Psi-theory#MicroPsi_architecture

Curious Wavefunction makes a history of information and thermodynamics http://wavefunction.fieldofscience.com/2020/07/brains-computation-and-thermodynamics.html

ends it with the idea that our brain is a mixture of digital and analog processes, as posited by Von Neumann

Johnny von Neumann in his usual say-profound-things-in-throwaway-lines manner speculating that the brain is a mix of digital and analog, not just digital. (From Hubert Dreyfus’s still super-relevant “What Computers Cannot Do”) pic.twitter.com/OBb4iw8XzB

— Ash Jogalekar (@curiouswavefn) October 13, 2019

Sav Sidorov another Joscha Bach video with highlights https://savsidorov.substack.com/p/tldr-joscha-bach-artificial-consciousness

“Some people think that a simulation can’t be conscious, and only a physical system can, but they got it completely backwards. A physical system cannot be conscious, only a simulation could be conscious.”

Connection between information and entropy isn born: “When Shannon showed his result to the famous mathematician John von Neumann, von Neumann with his well-known lightning-fast ability to connect disparate ideas, immediately saw what it was: “You should call your function ‘entropy’”, he said, “firstly because that is what it looks like in thermodynamics, and secondly because nobody really knows what entropy is, so in a debate you will always have the upper hand.” Thus was born the connection between information and entropy.”