https://adversarial-ml-tutorial.org/
- Algo. + hyperparameters -> joint training
- hyperparameters optimization -> blackbox (too slow for large datasets)
- blackbox <- bayersian optimization
- Non-blackbox approaches
- hyperparameter Gradient Descent
- Probabilistic extropolation of learning curve
- Multi-fidelity optimization