Abstract

Deep learning is a subfield of machine learning that has gained significant popularity in recent years due to its ability to achieve state-of-the-art results in a variety of applications, ranging from computer vision and natural language processing to robotics and gaming. It is based on artificial neural networks, which are designed to mimic the structure and function of the human brain. In this book, we provide a comprehensive overview of deep learning, including its definition, history, key characteristics, limitations, and applications. Chapter 1, we delve into the fundamentals of deep learning, including its definition, historical overview, and the differences between deep learning and machine learning. Additionally, we introduce Bayesian learning concepts, which are an important aspect of deep learning. We also cover the concept of decision surfaces and how they can be used to visualize and interpret the results of deep learning algorithms. Chapter 2 focuses on linear classifiers, including linear discriminant analysis, logistic regression, and the perceptron algorithm. We also cover linear machines with hinge loss, which is a popular optimization technique used in deep learning. Chapter 3 discusses various types of optimization techniques, including gradient descent and batch optimization. We provide an overview of each optimization method, as well as their variants, and explain how they work. Chapter 4, we introduce neural networks, including the structure of neural networks, how they work, and the key components of neural networks. We then delve into the multilayer perceptron, which is one of the most commonly used neural network architectures, and the back propagation learning algorithm, which is used to train neural networks.

Keywords: Machine learning, Artificial neural networks, Computer vision, Natural language processing, Robotics, Gaming, State-of-the-art results, Human brain, Comprehensive overview, Bayesian learning, Decision surfaces, Linear classifiers, Linear discriminant analysis, Logistic regression, Perceptron algorithm, Linear machines, Hinge loss, Optimization techniques, Gradient descent, Batch optimization, Neural networks, Multilayer perceptron, Back propagation learning algorithm, Key components, Training neural networks

Bibliography

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. Cambridge: MIT press.
Chollet, F. (2018). Deep learning with Python. Shelter Island, NY: Manning Publications Co.
Nielson, M. A. (2015). Neural networks and deep learning: A text book. Dordrecht: Springer.
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1), 1929-1958.
Geron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. Shelter Island, NY: O’Reilly Media, Inc.
Haykin, S. (2014). Neural networks and learning machines (3rd ed.). Upper Saddle River, NJ: Prentice Hall.
Brownlee, J. (2018). Deep learning for computer vision. Packt Publishing Ltd.

Webliography

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT press. Retrieved from http://www.deeplearningbook.org/
Kelleher, J. D., Mac Namee, B., & D’Arcy, A. (2015). Fundamentals of machine learning for predictive data analytics: algorithms, worked examples, and case studies. MIT press. Retrieved from https://mitpress.mit.edu/books/fundamentals-machine-learning-predictive-data-analytics
Kelleher, J. D., Mac Namee, B., & D’Arcy, A. (2015). Machine learning: a probabilistic perspective. MIT press. Retrieved from https://mitpress.mit.edu/books/machine-learning-probabilistic-perspective
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444. Retrieved from https://www.nature.com/articles/nature14539
Witten, I. H., Frank, E., Hall, M. A., & Pal, C. J. (2016). Data mining: practical machine learning tools and techniques. Morgan Kaufmann Publishers.https://www.elsevier.com/books/data-mining/witten/978-0-12-805309-3

Book Citation

Dr. E. Srividhya, Dr. S. Jayanthi, Ms. Suja Cherukullapurath Mana, Ms. V. R. Niveditha, Mr. Amandeep Singh K.,(2022). An Approach to Deep Learning(1st ed., Vol. 1). Magestic Technology Solutions (P) Ltd. ISBN: 978-93-92090-12-7. DOI: https://doi.org/10.47716/MTS.B.978-93-92090-12-7