Abstract
Neural network algorithms are similar in structure to the human mind, they work in the same way as the mind works in transmitting, processing and analyzing information, reaching conclusions, discovering patterns and predictions and we can apply some of what the natural mind applies, although scientists are still discovering more about it until now and have not met all its details. The nature of the algorithms of these networks contributed to them being the most widely used in the field of artificial intelligence, as they aim to simulate human intelligence and give the machine some of the capabilities of the human mind. In this research paper we presented the study of the gradient descent algorithm and the gradient descent algorithm with momentum on a model of an objective function and by comparing their results it was shown that the gradient descent algorithm with momentum leads to better and faster learning and with less repetition compared with the gradient descent in reaching the optimal value and the results were calculated using Python. Keywords: Optimization Algorithm, Algorithm of Neural Network, Cost Function.
Keywords
Algorithm of Neural Network
Cost Function
Gradient Descent
Lion optimization algorithm
Momentum
Keywords
خوارزمية الأسد المحسنة
خوارزمية الشبكة العصبية
دَفعَة
نزول التدرج
وظيفة التكلفة