How to hyperparameter search over different dataset sizes simultaneously

[mmcdermott]

Hi All,

I am studying the behavior of neural network models as a function of dataset size; to this end, I need to ensure I use appropriately tuned models for each different dataset size I study. I could just choose a static set of dataset sizes and run independent hyperparameter searches for each, of course, but that seems wasteful as the hyperparameters chosen should be correlated across the different dataset sizes, so if I somehow could do all the searches at once, while still ensuring I search over all dataset sizes sufficiently, that would be better. Is such a thing possible in Optuna? Thanks!