Loading...
Non-Convex Optimization: RMSProp Based Optimization for Long Short-Term Memory Network
Journal Title
Readers/Advisors
Journal Title
Term and Year
Publication Date
2020-05-09
Book Title
Publication Volume
Publication Issue
Publication Begin
Publication End
Number of pages
Files
Research Projects
Organizational Units
Journal Issue
Abstract
This project would give a comprehensive picture of non-convex optimization for deep learning, explain in details about Long Short-Term Memory (LSTM) and RMSProp. We start by illustrating the internal mechanisms of LSTM, like the network structure and backpropagation through time (BPTT). Then introducing RMSProp optimization, some relevant mathematical theorems and proofs in those sections, which give a clear picture of how RMSProp algorithm is helpful to escape the saddle point. After all the above, we apply it with LSTM with RMSProp for the experiment; the result would present the efficiency and accuracy, especially how our method beat traditional strategy in non-convex optimization.
Citation
Yan, J., & Andriamanalimanana, B. (2020, May 9). Non-Convex Optimization: RMSProp Based Optimization for Long Short-Term Memory Network: A Project Submitted to the Graduate Faculty of the State University of New York Polytechnic Institute in Partial Fulfillment of the Requirements for the Degree of Master of Science. Department of Computer Science and Software Engineering, College of Engineering, SUNY Polytechnic Institute.