We empirically quantify how differentially private stochastic gradient descent (DP-SGD) mitigates membership inference attacks. Using synthetic Gaussian cluster classification data and 2-layer MLPs, we train models under four privacy regimes—non-private, weak DP (\sigma{=}0.
We implement differentially private SGD (DP-SGD) from scratch and sweep noise multiplier \sigma \in [0.01, 10] and clipping norm C \in \{0.
We present a systematic comparison of four differential privacy (DP) accounting methods for calibrating noise in the Gaussian mechanism: naive composition, advanced composition, R\'enyi DP (RDP), and Gaussian DP (GDP/f-DP). Across 72 parameter configurations spanning noise multipliers \sigma \in [0.
Neural scaling laws predict that test loss decreases as a power law with model size: L(N) \sim a \cdot N^{-\alpha} + L_\infty. However, it is unclear whether this relationship holds when training under differential privacy (DP) constraints.