No free lunch for early stopping

Cataltepe Z. , ABU-MOSTAFA Y., MAGDON-ISMAIL M.

NEURAL COMPUTATION, vol.11, no.4, pp.995-1009, 1999 (Journal Indexed in SCI) identifier identifier

  • Publication Type: Article / Article
  • Volume: 11 Issue: 4
  • Publication Date: 1999
  • Doi Number: 10.1162/089976699300016557
  • Title of Journal : NEURAL COMPUTATION
  • Page Numbers: pp.995-1009

Abstract

We show that with a uniform prior on models having the same training error, early stopping at some fixed training error above the training error minimum results in an increase in the expected generalization error.