Ημερομηνία: Παρασκευή 13 Οκτωβρίου 2023
Ώρα: 15:00
Τόπος:https://uoa.webex.com/uoa/j.php?MTID=mf78e03e88d3805f2d80f9665a4aab6e0
Oμιλητής: Gabriel Clara, υποψήφιος διδάκτορας του Τμήματος Εφαρμοσμένων Μαθηματικών του Πανεπιστημίου του Twente
Τίτλος: Dropout Regularization Versus L2-Penalization in the Linear Model
Περίληψη: We investigate the statistical behavior of gradient descent iterates with dropout in the linear regression model. In particular, non-asymptotic bounds for expectations and covariance matrices of the iterates are derived. In contrast with the widely cited connection between dropout and L2-regularization in expectation, the results indicate a much more subtle relationship, owing to interactions between the gradient descent dynamics and the additional randomness induced by dropout. This talk is based on joint work with Sophie Langer and Johannes Schmidt-Hieber.