


Quantum Neural Thermodynamics in Neural Predictive Coding & AI Probalistuc Compression.
May 8, 2025
AI scaling exposes intelligence as thermodynamically constrained, requiring energy-efficient architectures.
.
This seminar guided by Malcolm Ramsay - St. Claire paper and research on Quantum Neural Thermodynamics in Neural Predictive Coding & AI Probalistuc Compression.
We investigated how overwhelming information loads demand unsustainable energy outputs, revealing the limits of current infrastructures and the growing tension between data expansion and energy scarcity. AI scaling exposes a fundamental constraint: intelligence is thermodynamically expensive.
The brain resolves this via predictive coding - minimizing free energy through hierarchical inference - whereas large language models approximate this through probabilistic compression over token space. However, current architectures externalize entropy costs into infrastructure, producing ecological strain.
This asymmetry reveals a critical inefficiency: biological cognition is entropy - adaptive, whereas LLMs are entropy - extractive. Friston’s free - energy principle suggests a pathway - intelligence must minimize surprise relative to energetic cost. Without such integration, scaling laws risk collapse under resource constraints. The future of AI depends on energy - aware architectures that couple inference with thermodynamic optimization.
Citations:
Friston, K. (2010). Free-energy principle. Nat Rev Neurosci, 11, 127–138. https://doi.org/10.1038/nrn2787
Kaplan, J., et al. (2020). Scaling laws for neural language models. https://arxiv.org/abs/2001.08361
Hinton, G., & Sejnowski, T. (1999). Unsupervised learning. MIT Press. https://mitpress.mit.edu/9780262581684/unsupervised-learning/