Abstract: For over two decades, the Hubble Space Telescope has been heavily used to locate supernovae in high redshift environments, with the primary goal of improving constraints on the nature of dark energy. Along the way we have made surprising observations on the nature of supernovae themselves, and clues to their elusive progenitor mechanisms, some of which are difficult to reconcile with observations at much lower redshift.  From complete volumetric supernova rate histories, that now extend to z > 2, we find type Ia supernova delay-time distributions are consistent with a power law of index -1, but with the fraction of prompt (t_d < 500 Myr) much less than expected from various ground-based surveys. Core collapse supernova rates trace the cosmic star formation rate history, but require stellar progenitors more massive than have been seen in deep studies of nearby events. I will detail our current campaigns on clusters of galaxies, where gravitational lens magnification provides a real potential for locating the first, primordial supernovae, while also providing useful constraints on the mass models of the foreground gravitational lenses.