Many modern machine learning problems can be cast as bilevel optimization problems: few-shot learning, causality, model selection, dataset distillation, adversarial attacks etc. More generally, ...
Automatic Differentiation (AD) forms a cornerstone in the optimisation of machine learning models, providing an efficient computational method to obtain accurate derivatives. This technique underpins ...