Introduction to the Math of Neural Networks – Jeff Heaton

If you have read other books I have written, you will know that I try to shield the reader from the mathematics behind Al. Often, you do not need to know the exact math that is used to train a neural network or perform a cluster operation. You simply want the result. This results-based approach is very much the focus of the Encog project. Encog is an advanced machine learning framework that allows you to perform many advanced operations, such as neural networks, genetic algorithm, support vector machines, simulated annealing and other machine learning methods. Encog allows you to use these advanced techniques without needing to know what is happening behind the scenes.

However, sometimes you really do want to know what is going on behind the scenes. You do want to know the math that is involved. In this book, you will learn what happens, behind the scenes, with a neural network. You will also be exposed to the math. There are already many neural network hooks that at first glance appear as a math text. This is not what I seek to produce here. There are already several very good books that achieve a pure mathematical introduction to neural networks. My goal is to produce a mathematically-based neural network book that targets someone who has perhaps only college-level algebra and computer programing background. These are the only two prerequisites for understanding this book, aside from one more that I will mention later in this introduction. Neural networks overlap several bodies of mathematics.

Neural network goals, such as classification, regression and clustering, come from statistics. The gradient descent that goes into bacicpropagation, along with other training methods, requires knowledge of Calculus. Advanced training, such as Levenberg Marquardt, require both Calculus and Matrix Mathematics. To read nearly any academic-level neural network or machine learning targeted book, you will need some knowledge of Algebra, Calculus, Statistics and Matrix Mathematics. However, the reality is that you need only a relatively small amount of knowledge from each of these areas. The goal of this book is to teach you enough math to understand neural networks and their training.

Related posts:

Fundamentals of Deep Learning - Nikhil Bubuma
Pro Deep Learning with TensorFlow - Santunu Pattanayak
Deep Learning - A Practitioner's Approach - Josh Patterson & Adam Gibson
Deep Learning Illustrated - A visual, Interactive Guide to Arficial Intelligence First Edition - Jon...
R Deep Learning Essentials - Dr. Joshua F.Wiley
Deep Learning with Applications Using Python - Navin Kumar Manaswi
Intelligent Projects Using Python - Santanu Pattanayak
Python Deep Learning - Valentino Zocca & Gianmario Spacagna & Daniel Slater & Peter Roelants
Amazon Machine Learning Developer Guild Version Latest
Deep Learning dummies first edition - John Paul Mueller & Luca Massaron
Practical computer vision applications using Deep Learning with CNNs - Ahmed Fawzy Gad
Introduction to Machine Learning with Python - Andreas C.Muller & Sarah Guido
An introduction to neural networks - Kevin Gurney & University of Sheffield
Applied Text Analysis with Python - Benjamin Benfort & Rebecca Bibro & Tony Ojeda
Introduction to Deep Learning Business Application for Developers - Armando Vieira & Bernardete Ribe...
Artificial Intelligence - 101 things you must know today about our future - Lasse Rouhiainen
Building Chatbots with Python Using Natural Language Processing and Machine Learning - Sumit Raj
Natural Language Processing Recipes - Akshay Kulkni & Adarsha Shivananda
Python Data Analytics with Pandas, NumPy and Matplotlib - Fabio Nelli
Deep Learning with Hadoop - Dipayan Dev
Python for Programmers with introductory AI case studies - Paul Deitel & Harvey Deitel
Foundations of Machine Learning second edition - Mehryar Mohri & Afshin Rostamizadeh & Ameet Talwalk...
Hands-On Machine Learning with Scikit-Learn and TensorFlow - Aurelien Geron
Scikit-learn Cookbook Second Edition over 80 recipes for machine learning - Julian Avila & Trent Hau...
Python Machine Learning Third Edition - Sebastian Raschka & Vahid Mirjalili
Generative Deep Learning - Teaching Machines to Paint, Write, Compose and Play - David Foster
Deep Learning with Python - Francois Chollet
Natural Language Processing in action - Hobson Lane & Cole Howard & Hannes Max Hapke
Machine Learning - An Algorithmic Perspective second edition - Stephen Marsland
Learning scikit-learn Machine Learning in Python - Raul Garreta & Guillermo Moncecchi
Machine Learning - The art and science of alhorithms that make sense of data - Peter Flach
Building Machine Learning Systems with Python - Willi Richert & Luis Pedro Coelho