There's another very obvious counterexample: assertions. Buried within the source code to ArcLite is an assert function and several assertions. These are not strictly necessary; the functional behavior of a program is the same whether or not it has assertions. But they were very necessary for debugging, and they continued to catch other bugs long after they'd served their original purpose.
