## A Comparison of Optimization Algorithms for Deep Learning

**Authors:** [Derya Soydaner](/content/authors/derya-soydaner-4ci276gwc3/index.html), [Mimar Sinan Fine Arts University](/content/institutions/mimar-sinan-fine-arts-university-3kg0ly1v/index.html)

- **Date:** 30 Apr 2020
- **Journal:** [International Journal of Pattern Recognition and Artificial Intelligence](/content/journals/international-journal-of-pattern-recognition-and-artificial-ujqowwne/index.html), Vol. 34, Iss: 13, pp 2052013
- **DOI:** [10.1142/S0218001420520138](https://doi.org/10.1142/S0218001420520138)

### TL;DR
The behaviour of the algorithms during training and results on four image datasets, namely, MNIST, CIFAR-10, Kaggle Flowers and Labeled Faces in the Wild are compared by pointing out their differences against basic optimization algorithms.

### Abstract
In recent years, we have witnessed the rise of deep learning. Deep neural networks have proved their success in many areas. However, the optimization of these networks has become more difficult as ...

### Citations
- **Showing all 110 results**
  - **Journal Article** [Human activity recognition in artificial intelligence framework: a narrative review](/content/papers/human-activity-recognition-in-artificial-intelligence-33a6vhf9/index.html) by [Neha Gupta](/content/authors/neha-gupta-4yp2zm0q/index.html), [Suneet K. Gupta](/content/authors/suneet-k-gupta-3n34l7hzn9/index.html), [Rajesh Kumar Pathak](/content/authors/rajesh-kumar-pathak-57ye0hk105/index.html), [Vanita Jain](/content/authors/vanita-jain-2j06755ms9/index.html), and [Parisa Rashidi](/content/authors/parisa-rashidi-4hrsaxfxrw/index.html)
  - **TL;DR:** In this article, a detailed narration on the three pillars of human activity recognition (HAR) is presented covering the period from 2011 to 2021, and the review presents the recommendations for an improved HAR design, its reliability, and stability.

- **Proceedings Article** [Prediction of lung and colon cancer through analysis of histopathological images by utilizing Pre-trained CNN models with visualization of class activation and saliency maps](/content/papers/prediction-of-lung-and-colon-cancer-through-analysis-of-59z4q65tp4/index.html) by [Satvik Garg](/content/authors/satvik-garg-38usj9a4ze/index.html) and [Somya Garg](/content/authors/somya-garg-1ubej5orky/index.html) 
  - **TL;DR:** In this paper, eight distinctive pre-trained CNN models, VGG16, NASNetMobile, InceptionV3, INceptionResNetV2, ResNet50, Xception, MobileNet, and DenseNet169 are trained on LC25000 dataset.

### References
1. [Very Deep Convolutional Networks for Large-Scale Image Recognition](/content/papers/very-deep-convolutional-networks-for-large-scale-image-30n8jg2cdx/index.html) by [Karen Simonyan](/content/authors/karen-simonyan-2uryi13ccv/index.html) and [Andrew Zisserman](/content/authors/andrew-zisserman-3mwctvbpgu/index.html) 
   - **TL;DR:** This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting.

2. [ImageNet classification with deep convolutional neural networks](/content/papers/imagenet-classification-with-deep-convolutional-neural-3kv7rezkq1/index.html) by [Alex Krizhevsky](/content/authors/alex-krizhevsky-4yc36t60l3/index.html), [Ilya Sutskever](/content/authors/ilya-sutskever-3gzcsenyze/index.html), and [Geoffrey E. Hinton](/content/authors/geoffrey-e-hinton-1o16xmi2re/index.html) 
   - **TL;DR:** A large, deep convolutional neural network was trained to classify images in the ImageNet LSVRC-2010 contest.