Showing posts with label statistical mechanics. Show all posts
Showing posts with label statistical mechanics. Show all posts
Tuesday, 3 June 2025

Compressive algorithmic randomness:
Gibbs-randomness proposition for massively energy efficient deep learning

›
Figure: Dual Tomographic Compression Performance, Süzen, 2025. Preamble Randomness is elusive and its probably one of the outstanding concep...
Tuesday, 22 April 2025

Ultimate physical limit of data storage:
Connecting Bekenstein Bound to Landauer Principle

›
Preamble   Bekenstein's Information (Wikipedia) Black holes are not too esoteric anymore after LIGO's success and successful imaging...
Saturday, 1 April 2023

Resolution of misconception of overfitting: Differentiating learning curves from Occam curves

›
Preamble   Occam (Wikipedia) A misconception that overfitted model can be identified with the  amount of  generalisation gap  between model...
Saturday, 25 February 2023

Loschimidt's Paradox and Causality:
Can we establish Pearlian expression for Boltzmann's H-theorem?

›
Boltzmann (Wikipedia) Post covers the papers: H-theorem do-conjecture, M. Süzen,   arxiv:2310.01458  (2023)  Preamble Probably the most imp...
Tuesday, 15 November 2022

Differentiating ensembles and sample spaces: Alignment between statistical mechanics and probability theory

›
Preamble  Sample space is the primary concept introduced in any probability and statistics books and in papers. However, there needs to be m...
Tuesday, 25 October 2022

Overfitting is about complexity ranking of inductive biases : Algorithmic recipe

›
Preamble     Figure: Moon patterns human brain  invents. (Wikipedia) Detecting overfitting is inherently a comparison problem of the complex...
Tuesday, 4 October 2022

Heavy-matter-wave and ultra-sensitive interferometry: An opportunity for quantum-gravity becoming an evidence based research

›
    Solar Eclipse of 1919 (wikipedia) Preamble       Cool ideas in theoretical physics are ofter opaque for general reader whether if they a...
Tuesday, 5 July 2022

Bayesian rabbit holes: Decoding conditional probability with non-commutative algebra

›
Preamble     The White Rabbit (Wikipedia) A novice analyst or even experienced (data) scientist would have thought that the bar notation $|$...
Wednesday, 11 May 2022

A misconception in ergodicity: Identify ergodic regime not ergodic process

›
Preamble       Figure 1: Two observable's approach to  ergodicity for Bernoulli Trials.  Ergodicity appears in many fields, in physics,...
Wednesday, 28 July 2021

Deep Learning in Mind a Gentle Introduction to Spectral Ergodicity

›
Preamble     Figure: Monalisa on Eigenvector grids (Wikipedia) In the post,  A New Matrix Mathematics for Deep Learning : Random Matrix Theo...
Saturday, 14 November 2020

Shannon's Entropy: Why it is called Entropy?

›
  The story (legend) goes like this, von Neumann was asked by Shannon what he thinks and suggested Shannon call it entropy.  Shannon's e...
2 comments: