NATIONAL POLYTECHNIC SCHOOL

FACULTY OF MECHANICAL ENGINEERING

MECHATRONICS
Name: Luis Felipe Galeano

Date: 23 – 12 – 2015

Group: Gr-2

HINTON DIAGRAM

The final approach we shall describe for evaluating the effectiveness of network
training is perhaps the most difficult of the three techniques; however, actually
performing the analysis is often a very enlightening experience. In essence, what this
technique ascribes is to dissect the network after training, examining the configuration
of the connection weights and identifying the features of the input pattern that the
network configured itself to organize.

The easiest method for accomplishing this analysis is to use a graphical tool called the
Hinton diagram allows the developer to view the activity of each unit in the network,
and to visualize the relative importance of each component of an input pattern to each
unit in the network .

Using the Hinton diagram to visualize activity in the network, the application developer
can identify the units in the network that respond to different pattern components.
This analysis can be performed using the exemplars from the training set, or can be
used only when specific pattern components are tested.

Similarly, we can use the Hinton diagram to visualize the input connection weights to
each unit in the network. In this manner, we can identify the features, or combinations
of features, in the input pattern that excited each unit. Likewise, we can easily identify
connections that inhibit the activation of each unit. By performing such an inspection
after training a network, we can determine the characteristics of the input that
network deemed important to successfully recognizing the exemplars. In practice, we
often find that a trained network has found the underlying relationships in the data.
We can then use that knowledge to further refine the training set, usually by
eliminating input components that the network did not use during training.

Hinton diagrams are useful for visualizing the values of a 2D array. Positive and
negative values are represented by white and black squares, respectively, and the size
of each square represents the magnitude of each value.
Example

Topic models represent a class of statistical models designed to extract meaningful

semantic structure from large document corpuses. It performs this by attempting to
capture relevant topics, where topics represent interesting probability distributions
over the vocabulary found in the dataset. It goes further and decomposes a document
as a mixture of these topics.

The Hinton diagram, which allows one to view correlations between topics