Ph.D. Spotlight: Generalization Performance and Properties of Pruned Neural Networks

By removing as much as 90% or more of a deep neural network’s (DNN’s) parameters, a wide variety of pruning approaches not only allow for DNN compression but also increase generalization (model performance on test/unseen data). This observation is in conflict with emerging DNN generalization theory and empirical observations, however, which suggest that DNNs generalize…