Logical Intelligence
Scale-Agnostic Kolmogorov-Arnold Geometry in Neural Networks

Researchers confirmed that Kolmogorov-Arnold Geometry (KAG) spontaneously emerges in standard multilayer perceptrons trained on high-dimensional MNIST image data, exhibiting a scale-agnostic organization from local to global input regions. The study found that spatial data augmentation moderates the intensity of KAG while preserving its qualitative patterns, suggesting a connection between data diversity and learned geometric structure.

View blog
Resources
Spontaneous Kolmogorov-Arnold Geometry in Shallow MLPs

Researchers from Logical Intelligence, Harvard, and UC Riverside investigated whether Kolmogorov-Arnold-like geometric structures naturally form in conventional shallow neural networks during optimization. They found that these geometries spontaneously emerge when models learn complex, nonlinear functions, and their presence correlates with improved learning performance.

View blog
Resources
There are no more papers matching your filters at the moment.