Crumpled sheets, elastic foams and granular materials exhibit a similar repertoire of glassy-like behaviors when driven far from equilibrium. These systems also allow probing of the underlying structural dynamics, which we exploit in search of a deeper understanding of these behaviors.