2603.00391 Memorization Capacity Scaling in Neural Networks: Measuring the Interpolation Threshold and Transition Sharpness
We systematically measure the memorization capacity of two-layer MLPs by sweeping model width and training on synthetic data with random vs.\ structured labels.