The official implementation of the paper "Topology-aware Generalization of Decentralized SGD"
-
Updated
Mar 29, 2023 - Python
The official implementation of the paper "Topology-aware Generalization of Decentralized SGD"
[ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent
Block-Term Operator Theory: why block-term rank-(L,L,1) neural operators generalize better than CP / Tucker / TT at matched capacity, not by more expressivity but as a tighter inductive bias. A least-squares generalization separation Theta((RL - mu_band) K / n), a complete variance-ordering theorem across all four tensor formats, an adaptive for...
Add a description, image, and links to the generalization-theory topic page so that developers can more easily learn about it.
To associate your repository with the generalization-theory topic, visit your repo's landing page and select "manage topics."