Skip to main content
King Abdullah University of Science and Technology
Applied Mathematics and Computational Sciences
AMCS
Applied Mathematics and Computational Sciences
  • Study
    • Prospective Students
    • Current Students
  • Research
    • Research Areas
    • Research Groups
  • People
    • All People
    • Faculty
    • Affiliate Faculty
    • Instructional Faculty
    • Research Scientists
    • Research Staff
    • Postdoctoral Fellows
    • Administrative Staff
    • Alumni
    • Students
  • News
  • Events
  • SIAM Student Chapter
  • CEMSE Division
  • About
  • Apply

gradient methods

On the Natural Gradient Descent

Prof. Levon Nurbekyan

Jun 11, 16:00 - 17:00

KAUST

gradient methods

Abstract Numerous problems in scientific computing can be formulated as optimization problems of suitable parametric models over parameter spaces. Neural network and deep learning methods provide unique capabilities for building and optimizing such models, especially in high-dimensional settings. Nevertheless, neural networks and deep learning techniques are often opaque and resistant to precise control of their mathematical properties in terms of architectures, hyperparameters, etc. Consequently, optimizing neural network models can result in a laborious hyperparameter tuning process that

Applied Mathematics and Computational Sciences (AMCS)

Footer

  • A-Z Directory
    • All Content
    • Browse Related Sites
  • Site Management
    • Log in

© 2024 King Abdullah University of Science and Technology. All rights reserved. Privacy Notice