This workshop will serve as basic introduction to black-box optimization approaches used in hyper-parameter optimization, namely: grid search, random search, bayesian optimization, simulated annealing, genetic algorithms. I will try to explain the algorithms in an intuitive way, with also code examples to demonstrate how to apply them.