If this continues, I'm going to need a new early-stopping criterion: When the performance on validation set is perfect.

Half right?

@Riedl They are doing your thing!