Introduction to Neural Networks and their Types

Introduction to Neural Networks and their Types

The word neural is derived from the word “neuron”. An Artificial neuron is the basic functional unit of the nervous system which is similar to biological neuron. A Neural Network or Artificial Neural Network is a biologically inspired neural network made by an interconnection of neurons.  Connections of neurons lead to transmit signal from one neuron to another. Neuron or their connections have some weight. There are different layers of a network interconnected by nodes. These Neural Networks are made to learn for performing classification, decision making, and other actions.

What is a Neural Network?

The first layer of the network is called input layer to which input is applied and the last layer is output layer which generates the output. Between input layer and output layer, there are hidden layers present. Nodes of the input layer are passive from which multiple outputs are generated and passed to next layer (hidden layer). Further, nodes of a hidden layer or output layers are active. In neurons, there is activation function which decides how powerful an output of neuron should be. Weights are the number of pulses sent by a neuron.

Main types of Neural Networks are as follow: 

  1. Feedforward Network (FFN): It is a classification algorithm basically used for supervised learning problems. It consists of different layers of processing units where each unit in the proceeding layer is connected with all units of the previous layer. Each connection has its own weight. Data is transferred from input layer to output layer by passing through hidden layers. In this feedforward network, there is no feedback or circulation between input and output unit, it operates in two phases learning phase and classification phase.
  2. Radial Basis Network: This network uses Radial Basis Function as an activation function in the hidden layer. A Radial Basis Function is a real-valued function defined as a distance of input from the origin. It is similar to feed forward Neural Network. Radial basis function's inputs and neuron parameters are combined linearly to get the output.
  3. Convolutional Neural Network (CNN): CNN consists of one or more convolutional layer which is mainly used for classification and image recognition. It is a typically connected MLP in which network learns from the filters sliding over an image which is called convolutional operation. It consists of pooling and fully connected layers. Filter bank or weights in convolutional layers are used because they decrease memory space and performance improvement. Performance becomes poor when input images are rotated i.e after different variations of objects in the image and rotation of an object, it is not able to predict accurate results.
  4. Capsule Network: Due to above limitations of Convolutional Networks CapsNet evolved. This network is trained with different rotations of the same image to produce an accurate outcome. Basically, this network is a nested set of neural layers in which more layers can be added inside a single layer. For each entity of an image, it represents a vector. An output is represented in form of a vector and oriented vector shows properties of an entity. This vector is sent to all parents of network and thus a prediction vector is found after multiplying its weight with the weight matrix.     
  5. Multilayer Perceptron (MLP): It is a feed-forward network having three layers of nodes i.e input layer, an output layer, and hidden layer. Nodes can be trained using a back-propagation technique. In hidden layer and output layer non-linear activation function is applied. All layers are fully connected in which each node consists of some weight. This network solves the problem in stochastically manner, hence used for solving complex problems. Even though it faces a lot of competition from support vector machine but the popularity of deep learning and back-propagation makes it effective.
  6. Recurrent Neural Network (RNN): These types of networks are used for sequential information. The sequence of input is given on the basis of which next output is produced. Both current, as well as previous inputs, are needed to predict the output. These networks are used for generating text, machine translation, chatbot and speech recognition etc.

Here is some brief description of different types of networks. Many organizations are providing online video training on this topic due to its increasing demand. Finally, the conclusion is that for different tasks and applications different types of Neural Networks are used.


Similar Articles

Top Reasons Why Aircraft Maintenance Is Essential

Precision is of the utmost significance in the aviation industry. Whether it’s a commercial plane or a civilian one, things need to be perfect all the time for the service provider to function normally. The aircraft maintenance and repair management don’t allow any room for mechanical or technical error, as a single mistake could lead to fatal accidents. 

mechanical services company

You can ask any business and company that are making use of machinery. The moment that a machine breaks or maintenance need to be done, then production is going to be on a standstill. And, it will stay at a standstill until the machinery is maintained and any faults repaired.


There is a huge variety of mechanical engineers in different fields. And, this can be quite hard and confusing to know the different type of engineers.

mechanical services company

With offshore industries, there are a number of difficulties they face on a daily basis. Challenges that are hard to overcome, because they are offshore and repairs of machinery and maintenance are hard to do.

high pressure water jetting hydroblasting

We are talking about industrial tanks that need to be cleaned. If you are working with industrial tanks, or you have equipment and chemicals that are getting stored in tanks, you will know what we are talking about. That these tanks need to be cleaned before it can be used again.


Not the best job in the world. To do drain cleaning. But sometimes this is important to clean your drain, because of a clogged drain, or maybe because your drain just has a stink to it.


Any industrial company or even business needs to be cleaned. Some are doing it themselves; some are hiring cleaners and others are hiring services that come and cleans after hours. But did you ever consider making use of a green industrial cleaning service?

catalyst handling services

With the use of catalysts, reactors need to be unloaded. The problem is that with the wrong unloading method, damage can be done to the reactor and the catalysts. This is why it is so important that the correct reactor unloading method is implemented.

catalyst handling services

When it comes to catalysts unloading and loading procedures for global licenses, certain procedures need to be followed. This is to ensure that the right safety precautions are followed when catalyst handling is performed.