Exploiting Structure for Scalable and Robust Deep Learning