Show simple item record

Progress and future directions in machine learning through control theory

dc.contributor.authorZuazua, Enrique
dc.date.accessioned2024-09-24T10:08:37Z
dc.date.available2024-09-24T10:08:37Z
dc.date.issued2024
dc.identifier.citationZuazua, E. (2024). Progress and future directions in machine learning through control theory. En Gallego, R. & Mateos, M. (coords.), Libro de Resumenes del FGS 2024 (French-German-Spanish Conference on Optimization). Universidad de Oviedo.
dc.identifier.isbn978-84-10135-30-7
dc.identifier.urihttps://hdl.handle.net/10651/74691
dc.description.abstractThis paper presents our recent advancements at the intersection of machine learning and control theory. We focus specifically on utilizing control theoretical tools to elucidate the underlying mechanisms driving the success of machine learning algorithms. By enhancing the explainability of these algorithms, we aim to contribute to their ongoing improvement and more effective application. Our research explores several critical areas: Firstly, we investigate the memorization, representation, classification, and approximation properties of residual neural networks (ResNets). By framing these tasks as simultaneous or ensemble control problems, we have developed nonlinear and constructive algorithms for training. Our work provides insights into the parameter complexity and computational requirements of ResNets. Similarly, we delve into the properties of neural ODEs (NODEs). We demonstrate that autonomous NODEs of sufficient width can ensure approximate memorization properties. Furthermore, we prove that by allowing biases to be time-dependent, NODEs can track dynamic data. This showcases their potential for synthetic model generation and helps elucidate the success of methodologies such as Reservoir Computing. Next, we analyze the optimal architectures of multilayer perceptrons (MLPs). Our findings offer guidelines for designing MLPs with minimal complexity, ensuring efficiency and effectiveness for supervised learning tasks.spa
dc.language.isospaspa
dc.relation.ispartofFGS 2024 French-German-Spanish Conference on Optimizationspa
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 Internacional*
dc.rights© 2024 Universidad de Oviedo
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.titleProgress and future directions in machine learning through control theoryspa
dc.typebook partspa
dc.rights.accessRightsopen access
dc.relation.ispartofURIhttps://hdl.handle.net/10651/74677
dc.type.hasVersionVoRspa


Files in this item

untranslated

This item appears in the following Collection(s)

Show simple item record

Attribution-NonCommercial-NoDerivatives 4.0 Internacional
This item is protected with a Creative Commons License