1. The reusable holdout: Preserving validity in adaptive data analysis
by Cynthia Dwork, Vitaly Feldman, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Aaron Roth
Science
Volume 349(6248):
August 7, 2015
Published by AAAS

2. Fig. 1 Learning uncorrelated label.
Learning uncorrelated label. (A) Using the standard holdout. (B) Using Thresholdout. Vertical axes indicates average classification accuracy over 100 executions (margins are SD) of the classifier on training, holdout, and fresh sets. Horizontal axes show the number of variables selected for the classifier.
Cynthia Dwork et al. Science 2015;349:
Published by AAAS

3. Fig. 2 Learning partially correlated label with standard holdout.
Learning partially correlated label with standard holdout. (A) Using the standard holdout algorithm. (B) Using Thresholdout. Axes are as in Fig. 1.
Cynthia Dwork et al. Science 2015;349:
Published by AAAS