ANN & FUZZY Techniques (MEPS303B)

Q1. Short Questions (Attempt any 5) :-

I. Discuss the biological neurons and their artificial models.

Ans. Artificial NN draw much of their inspiration from the biological nervous system. It is
therefore very useful to have some knowledge of the way this system is organized.

Most living creatures, which have the ability to adapt to a changing environment, need a
controlling unit which is able to learn. Higher developed animals and humans use very
complex networks of highly specialized neurons to perform this task.

The control unit - or brain - can be divided in different anatomic and functional sub-units,
each having certain tasks like vision, hearing, motor and sensor control. The brain is
connected by nerves to the sensors and actors in the rest of the body.

The brain consists of a very large number of neurons, about 1011 in average. These can be
seen as the basic building bricks for the central nervous system (CNS). The neurons are
interconnected at points called synapses. The complexity of the brain is due to the massive
number of highly interconnected simple units working in parallel, with an individual neuron
receiving input from up to 10000 others.

The neuron contains all structures of an animal cell. The complexity of the structure and of
the processes in a simple cell is enormous. Even the most sophisticated neuron models in
artificial neural networks seem comparatively toy-like.

II. Write a short note on the models of artificial neural networks.

Ans. A computing system that is designed to simulate the way the human brain analyzes and process
information. Artificial Neural Networks (ANN) is the foundation of Artificial Intelligence (AI) and solves
problems that would prove impossible or difficult by human or statistical standards. ANN has self-
learning capabilities that enable it produce better results as more data becomes available.

Artificial Neural Networks (ANN) are paving the way for life-changing applications to be developed for
use in all sectors of the economy. Artificial Intelligence (AI) platforms which are built on ANN are
disrupting the traditional way of doing things. From translating webpages to other languages to having a
virtual assistant order groceries online to conversing with chatbots to solve problems, AI platforms are
simplifying transactions and making services accessible to all at negligible costs
 III. What do you mean by unsupervised learning?
Ans. The organization of unlabeled data into similarity groups called clusters. • A cluster is a collection of
data items which are “similar” between them, and “dissimilar” to data items in other clusters.
Cluster evaluation (a hard problem) • Intra-cluster cohesion (compactness): – Cohesion measures how near
the data points in a cluster are to the cluster centroid. – Sum of squared error (SSE) is a commonly used
measure. • Inter-cluster separation (isolation): – Separation means that different cluster centroids should be
far away from one another. • In most applications, expert judgments are still the key.
IV. Explain the multi layer feed forward networks.

Ans. A feedforward neural network is an artificial neural network wherein connections between the units do not form a
cycle. As such, it is different from recurrent neural networks.
The feedforward neural network was the first and simplest type of artificial neural network devised.In this network, the

information moves in only one direction, forward, from the input nodes, through the hidden nodes (if any) and to the

output nodes. There are no cycles or loops in the network. The simplest kind of neural network is a single-layer

perceptron network, which consists of a single layer of output nodes; the inputs are fed directly to the outputs via a series

of weights. In this way it can be considered the simplest kind of feed-forward network. The sum of the products of the

weights and the inputs is calculated in each node, and if the value is above some threshold (typically 0) the neuron fires

and takes the activated value (typically 1); otherwise it takes the deactivated value (typically -1). Neurons with this kind

of activation function are also called artificial neurons or linear threshold units.

V. Enlist the basic concepts of dynamical systems.

Ans. Combining neural networks and fuzzy systems, this presents neural networks as trainable dynamical systems and
develops mechanisms and principles of adaption, self-organization, covergence and global stability. It also includes the
new geometric theory of fuzzy sets, systems and associative memories. Kosko shows how to apply fuzzy theory to
adaptive control and how to generate structured fuzzy systems with unsupervised neural techniques. The book is designed
to be appropriate for courses in engineering, computer science, mathematics, psychology and biology. Neural, fuzzy and
neural-fuzzy IBM PC software is included.

VI. Describe the bi-directional associative memory & associative.

Ans. Bidirectional associative memory (BAM) is a type of recurrent neural network. BAM was introduced by Bart

Kosko in 1988.[1] There are two types of associative memory, auto-associative and hetero-associative. BAM is hetero-
associative, meaning given a pattern it can return another pattern which is potentially of a different size. It is similar to
the Hopfield network in that they are both forms of associative memory. However, Hopfield nets return patterns of the same
 size. A BAM contains two layers of neurons, which we shall denote X and Y. Layers X and Y are fully connected to each
other. Once the weights have been established, input into layer X presents the pattern in layer Y, and vice versa.

Q2. Long Questions (Attempt any 5) :- (5*14)

I. Elaborate the neural network learning.

Ans. Learning rule or Learning process is a method or a mathematical logic which improves the artificial neural
network's performance and usually this rule is applied repeatedly over the network. It is done by updating the weights
and bias levels of a network when a network is simulated in a specific data environment. [1] A learning rule may accept
existing condition ( weights and bias ) of the network and will compare the expected result and actual result of the
network to give new and improved values for weights and bias. [2]Depending on the complexity of actual model, which is
being simulated, the learning rule of the network can be as simple as an XOR gate or Mean Squared Error or it can be
the result of multiple differential equations. The learning rule is one of the factors which decides how fast or how accurate
the artificial network can be developed. Depending upon the process to develop the network there are three main models
of machine learning:

1. Unsupervised learning
2. Supervised learning
3. Reinforcement learning

II. Write a detail note on the linear machine.

Ans. Linear learning machines • In supervised learning, the learning machine is given a
training set of examples (inputs) with associated labels (output values). S = ¡ (x1, y1), (x2,
y2), . . . , (x`, y`) ¢ ⊆ (X × Y ) ` (` denotes number of training samples, xi are examples or
instances, and yi their labels). • A training set S is said to be trivial if all labels are equal. •
Usually the input space is a subset of the real value space, X ⊆ R n (n is the dimension of
the input space). The input x = (x1, x2, . . . , xn) 0 is a vector length n ( 0 denotes matrix
transposition). • Linear functions are probably the best understood and simplest hypothesis.
• A learning machine using a hypothesis that forms linear combinations of the input variables
is known as a linear learning machine
III. Give a detail note on the fuzzification and defuzzification methods.
Ans. Fuzzification Fuzzification is the first step in the fuzzy inferencing process. This
involves a domain transformation where crisp inputs are transformed into fuzzy inputs. Crisp
inputs are exact inputs measured by sensors and passed into the control system for
processing, such as temperature, pressure, rpm's, etc.. Each crisp input that is to be
processed by the FIU has its own group of membership functions or sets to which they are
transformed. This group of membership functions exists within a universe of discourse that
holds all relevant values that the crisp input can possess. The following shows the structure
of membership functions within a universe of discourse for a crisp input.
degree of membership: degree to which a crisp value is compatible to a membership
function, value from 0 to 1, also known as truth value or fuzzy input. membership function,
MF: defines a fuzzy set by mapping crisp values from its domain to the sets associated
degree of membership. crisp inputs: distinct or exact inputs to a certain system variable,
usually measured parameters external from the control system, e.g. 6 Volts. label:
descriptive name used to identify a membership function. scope: or domain, the width of the
membership function, the range of concepts, usually numbers, over which a membership
function is mapped. universe of discourse: range of all possible values, or concepts,
applicable to a system variable.

Defuzzification involves the process of transposing the fuzzy outputs to crisp outputs. There
are a variety of methods to achieve this, however this discussion is limited to the process
used in this thesis design. A method of averaging is utilized here, and is known as the
Center of Gravity method or COG, it is a method of calculating centroids of sets. The output
membership functions to which the fuzzy outputs are transposed are restricted to being
singletons. This is so to limit the degree of calculation intensity in the microcontroller. The
fuzzy outputs are transposed to their membership functions similarly as in fuzzification. With
COG the singleton values of outputs are calculated using a weighted average, illustrated in
the next figure. The crisp output is the result and is passed out of the fuzzy inferencing
system for processing elsewhere.

IV. What are the special forms of fuzzy logic models? Describe.
Ans.
V. Mention the classical fuzzy control problems.
Ans.
VI. Examine the adaptive fuzzy systems & hybrid systems.
Ans.
VII. What is delta learning rule for multi perceptron layer? Describe.
Ans.