Structure, Symmetry, and Singularity in Learning Systems

Salvato in:
Dettagli Bibliografici
Pubblicato in:ProQuest Dissertations and Theses (2025)
Autore principale: Li, Jiayi
Pubblicazione:
ProQuest Dissertations & Theses
Soggetti:
Accesso online:Citation/Abstract
Full Text - PDF
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!

MARC

LEADER 00000nab a2200000uu 4500
001 3282935759
003 UK-CbPIL
020 |a 9798270213121 
035 |a 3282935759 
045 2 |b d20250101  |b d20251231 
084 |a 66569  |2 nlm 
100 1 |a Li, Jiayi 
245 1 |a Structure, Symmetry, and Singularity in Learning Systems 
260 |b ProQuest Dissertations & Theses  |c 2025 
513 |a Dissertation/Thesis 
520 3 |a We study structural, algebraic, and statistical aspects of learning systems, with an emphasis on understanding how structure, symmetry, and singularity influence their behavior. Part I examines models whose parameterizations or loss landscapes have polynomial or rational form. Using tools from algebraic geometry and numerical algebraic geometry, we investigate the geometry of their critical sets, the role of degeneracies and singularities, and the symmetries that arise from overparameterization or model design. This part also considers rational neural networks, for which we introduce algebraic regularization schemes aimed at improving trainability and analyze the resulting optimization landscapes through a combination of theoretical and numerical methods. Part II focuses on learning systems motivated by applications in statistics and engineering. Here we study procedures for estimating means of bounded random variables based on betting strategies, with an emphasis on statistical guarantees and practical performance. We also explore models of resilience and recovery in artificial and biological neural networks and investigate machine learning components used in digital twins for manufacturing systems, where structural assumptions play a central role in inference and control. The application of algebraic and numerical algebraic tools to machine learning theory is still at an early stage, and many questions remain open. A deeper understanding of how algebraic structure aligns with learning dynamics, how singularities arise in parameterized models, and how these features relate to implicit bias and other emergent phenomena may provide valuable insight. The mathematical ideas explored in this thesis reflect only a small part of what may be possible, but working with these tools has been a source of enjoyment due to the elegance they bring to complex systems. I hope that readers will find the methods and perspectives presented here accessible and motivating for future exploration. 
653 |a Statistics 
653 |a Industrial engineering 
653 |a Computer science 
653 |a Artificial intelligence 
773 0 |t ProQuest Dissertations and Theses  |g (2025) 
786 0 |d ProQuest  |t ProQuest Dissertations & Theses Global 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/3282935759/abstract/embedded/Y2VX53961LHR7RE6?source=fedsrch 
856 4 0 |3 Full Text - PDF  |u https://www.proquest.com/docview/3282935759/fulltextPDF/embedded/Y2VX53961LHR7RE6?source=fedsrch