The development of time-domain integral equation solvers with robust late-time stability properties has been a long-standing quest. Among the many methods that have been investigated, those leveraging quasi-exact integration techniques appear to be most successful. This article presents stable and accurate marching-on-in-time (MOT) solvers for time-domain electric, magnetic, and combined field integral equations (EFIE, MFIE, and CFIE) based on quasi-exact integration techniques. The novel MOT solvers exhibit excellent stability while yielding highly accurate results, as demonstrated by various numerical examples. In addition, the solvers' excellent stability and accuracy properties are used to examine spurious modes encountered when time-domain integral equations are applied to closed surfaces. It is demonstrated that MOT solutions to the time domain EFIE and MFIE often are polluted by spurious modes at the cavity's resonant frequencies whereas those of the CFIE solver are devoid of such contamination.