WHITE PAPER

H3 TRENDS IN AI ALGORITHMS:
THE INFOSYS WAY

Abstract
Artificial Intelligence algorithms are the wheels of AI. To make the art
of possible applications of AI, a very good and deep understanding
of these algorithms is required. This paper tries to bring a perspective
on the landscape of various AI algorithms that will be shaping key
advancements across industries.
 Today, technology adoption is influenced At Infosys Center for Emerging With the emergence and availability of
by business and technology uncertainties. Technology solutions (iCETS), we several open datasets, computational
These uncertainties drive organisations continuously look at H2, and H3 thrust with GPU availability and maturity
to evaluate technology adoptions based technologies and their impact on client of Artificial Intelligence (AI) algorithms, AI
on risks and returns. Broadly, technology landscapes. These H2 and H3 technologies is making strong inroads into current and
led disruptions can be classified into are very important to be monitored as they future of IT ecosystems. Today, AI plays
Horizon1, Horizon 2 and Horizon 3. Horizon have the potential to transform or disrupt an integral role in IT strategy by driving
1 or H1 technologies are those that are existing well-oiled business models, hence new experiences and creating new art of
in mainstream client adoptions and have fetching large returns. However, there possibilities. In this paper, we try to look
steady business transactions, while H2 are also associated risks from adoptions at important AI algorithms that are
and H3 are those that are yet to become that need to be monitored as some of shaping various H3 of AI possibilities.
mainstream but have started to spring those can have higher negative impact on While we do that, here is a chart
interesting possibilities and potential compliance, safety and so on. representing the broader AI algorithm
returns in the future. landscape in the context of this paper.

Algorithms Use Cases

erings
Off • Explainable AI • Scene Captioning
ng • Generative Networks • Scene detection
gi • Fine Grained Classification • Store Footfall counts
er

Emerging Investment
Em

• Capsule Networks • Specific object class detection

Opportunities • Meta Learning • Sentence Completion
Envision •
•
Transfer Learning (Text)
Single Shot Learning
•
•
Video Scene prediction
Auto learning
Invent • Reinforcement Learning • Fake images, Art generation
Technology Uncertainty

gs Disrupt • Auto ML • Music generation

rin
ffe • Neural Architecture Search (NAS) • Data Augmentation
lk
Wa
O
w

• Convolution Neural Networks (CNN) • Object detection

nd
Ne

w la • Long Term Short Term Memory • Product brand recognition,

Adopt Cra (LSTM) classification
Scale • Recurrent Neural Networks (RNN) • Facial Recognition
Incubated to New Offerings • Word2Vec • Speech Recognition
s Enhance
ring • GloVe • Speech Transcriptions
ffe • Transfer Learning (Vision) • Topic Classification, extraction
O
Core

n
Differentiate Ru • Logistic Regression • Recommendations
Diversify Main stream • Naive Bayes • Prediction
Deploy • Random Forest • Document, image
• Support Vector Machines (SVM) classification
Fl
y

• Collaborative Filtering • Document, image Clustering

• n-grams • Sentiment Analysis

Business Uncertainty

Figure 1.0: Horizon 3 AI Algorithms- Infosys Research

External Document © 2019 Infosys Limited

H1 of AI “core offerings” are typically
defined as algorithm powered use cases
that have become mainstream and will
remain major investment areas for the
current wave. In that respect, adoption
of use cases such as product or customer
recommendations, churn and sentiment
analysis and leveraging algorithms such as
Random Forest, Support Vector Machines
(SVM), Naïve Bayes, and n-grams based
approaches have been mainstream for
some time and will continue to get weaved
into varied AI experiences.
H2 of AI “new offerings” use cases are the
ones, that are currently in experimentative,
evolutionary mode and will have major
impact on Artificial Intelligent systems
Horizon 1
(Mainstream)
• Logistic Regression
• Naive Bayes
• Random Forest
• Support Vector Machines
(SVM)
Algorithms • Collaborative Filtering
• n-grams
• Recommendations
• Prediction
• Document, Image
Classification
• Document, Image Clustering
Use Cases • Sentiment Analysis
• Named Entity Recognition
(NER)
• Keyword Extractions
Table 1.0: H3 Algorithms and Usecases- Infosys Research
that will be mainstream in second wave.
Convolution Neural Networks (CNN) have
laid foundation for several art of possible
Computer Vision use cases ranging from
object detection, image captioning and
segmentation to facial recognition. Long
Term Short Term Memory(LSTM) and
Recurrent Neural Nets (RNN) are helping
to significantly improve art of possibilities
from use cases such as language
translations, sentence formulation, text
summarization, topic extraction and so on.
Word vectors based models such as GloVe
and Word2Vec are helping in dealing with
large multi dimensional text corpuses
and finding hidden unspotted complex
interwoven relationships and similarity
between topics, entities and keywords.
Horizon 2
(Adopt, Scale)
• Convolution Neural Networks
(CNN)
• Long Term Short Term
Memory (LSTM)
• Recurrent Neural Networks
(RNN)
• Word2Vec
• GloVe
• Transfer Learning (Vision)
• Object Detection
• Face Recognition
• Product Brand Recognition,
Classification
• Speech Recognition
• Sentence Completion
• Speech Transcriptions
• Topic Classification
• Topic Extraction
• Intent Mining
• Question Extraction
These H2 AI algorithms are promising
interesting new possibilities in various
business functions, however it is still in
nascent stage of adoption and user testing.
H3 of AI “emerging offerings” use cases
are the ones that are potential game
changers and can unearth new possibilities
from AI that are unexplored and
unimagined today. As these technologies
are relatively new, it requires more time
to establish its weaknesses, strengths and
nuances. In this paper, we look at key H3 AI
algorithmic trends, and how we leverage
these in various use cases built as part
of our IP, Infosys Enterprise Cognitive
platform (iECP).
Horizon 3
(Envision, Invent, Disrupt)
• Explainable AI
• Generative Networks
• Fine Grained Classification
• Capsule Networks
• Meta Learning
• Transfer Learning (Text)
• Single Shot Learning
• Reinforcement Learning
• Auto ML
• Neural Architecture Search
(NAS)
• Scene Captioning
• Scene Detection
• Store Footfall Counts
• Specific Object Class
Detection
• Sentence Completion
• Video Scene Prediction
• Auto Learning
• Fake Images, Art Generation
• Music Generation
• Data Augmentation
External Document © 2019 Infosys Limited
 Explainable AI (XAI)
Neural Network algorithms are considered
to derive hidden patterns from data that
many other conventional best of breed
Machine Learning algorithms such as
Support Vector Machines, Random Forrest,
Naïve Bayes, etc. are unable to establish.
However, there is an increasing rate of
incorrect and unexplainable decisions
and results produced by the Neural
Network algorithms in activities such
as credit lending, skilled job hiring and
facial recognition. Given this scenario,
AI results should be justified, explained
and reproduced for consistency and
correctness as some of these results can
Edges Textures
Figure 2.0: Feature Visualisation. Source: Olah, et al. 2017 (CC-BY 4.0)
Network dissection helps in associating
these established units to concepts.
They learn from labeled concepts during
supervised training stages, and how and in
what magnitude these are influenced by
channel activations.
Several frameworks are currently evolving
to improve the explainability of the
models. Two known frameworks in this
space are LIME and SHAP.
External Document © 2019 Infosys Limited
have profound impact on livelihood.
Geoffrey Hinton (University of Toronto),
often called the godfather of deep
learning, explains: “A deep-learning system
doesn’t have any explanatory power. The
more powerful the deep-learning system
becomes, the more opaque it can become.”
It is to address the issues of transparency
in AI that Explainable AI was developed.
Explainable AI (XAI) as a framework
increases the transparency of black-box
algorithms by providing explanations for
the predictions made and can accurately
explain a prediction at the individual level.
Patterns Parts
LIME ( Local Interpretability Model
agnostic Explanations): It treats the
model as a blackbox and tries to create
another surrogate non-linear model, where
explainablitiy is supported or feasible
such as SVM, Random Forest or Logistic
Regression. The surrogate non-linear
model is then used to evaluate different
components of the image by perturbing
the inputs and evaluating its impact
on the result. Thereby deciding which
Here are a few approaches provided
through certain frameworks that can help
understand the traceability of results.
Feature Visualization as depicted in figure
below helps in visualizing various layers in
a neural network. They help establish that
lower layers are useful in learning features
such as edges, and textures whereas
higher layer provides more of higher order
abstract concepts such as objects.
Objects
parts of the image are most important in
arriving at results. Since the original model
does not participate directly, it is model
independent. The challenge with this
approach is that even when the surrogate
model based explanations can be relevant
to the model it is used on, it may not be
generalizable precisely or become one to
one mappable to the original model all the
time.
Steps
1. Create set of noisy (perturbed) example
images by disabling certain features
(marking certain portions gray)
2. For each example, get the probability
that tree frog is in the image as per
original model
3. Using these created data points, train a
simple linear model (Logistic regression, (predicted - actual) and then computing
etc..) and get the results average of the score for that feature to
explain the results. For image use cases,
4. Superpixels with highest positive
it marks the dominating feature areas by
weights becomes an explanation
coloring the pixels in the image.
SHAP (SHapley Additive exPlanations):
SHAP produces relatively accurate results
It uses a game theory based approach
and is more widely used in Explainable AI
to predict the outcome by using various
as against LIME.
permutations and combinations of features
and their effect on the delta of the result

Figure 3.0: Explaining a Prediction with LIME. Source: Pol Ferrando, Understanding how LIME explains predictions

Generative AI
Generative AI will have a potentially
strong role in creative work, be it writing
articles, creating completely new images
from the existing set of trained models,
improving image or video quality, merging
images for artistic creations, in creating
music or improving dataset through data
generation. Generative AI as it matures, in
near term, will augment many jobs and will
potentially replace many in future.
Generative Networks consists of two deep
neural networks, a generative network
and a discriminative network. They work
together to provide high-level simulation
of conceptual tasks.
To train a Generative model, we first
collect a large amount of data in some
domain (e.g., think millions of images,
sentences, or sounds, etc.) and then
train the model to generate similar
data. Generative network generates the
data to fool the Discriminative Network
while Discriminative Network learns by
identifying real vs fake data received from
the Generative Network.
Generator trains with an objective function
on whether it can fool the discriminator
network, whereas discriminator trains on
its ability to not be fooled and correctly
identify real vs fake. Both network
learns through back propagation. The
generator is typically a deconvolutional
neural network, and the discriminator is a
convolutional neural network.
Generative Networks can be of multiple
types depending on the objective they are
designed for, example being.
Neural Style Transfer (NST)
Neural Style Transfer (NST) is one of the
Generative AI techniques in deep learning.
As seen below, it merges two images,
namely, a "content" image (C) and a "style"
image (S), to create a "generated" image
(G). The generated image G combines the
"content" of the image C with the "style" of
image S

External Document © 2019 Infosys Limited

 Content image Style image
Colorful circle Blue painting
Content image Style image
Louvre museum Impressionist style painting
Content image Style image
Ancient city of Persepolis The Starry Night
(Van Gogh)
Figure 4.0 : Novel Artistic Images through Neural Style Transfer. Source: Fisseha Berhane, Deep Learning & Art: Neural Style Transfer
Some of the other GAN variations that are and flowers.
popular are
· Sketch-GAN, a Generative model for
· Super Resolution GAN (SRGAN) that vector drawings, which is a Recurrent
helps improve quality of images. Neural Network (RNN) and is able to
construct stroke-based drawings of
· Stack-GAN that generates realistic
common objects. The model is trained
looking photographs from textual
on a dataset of human-drawn images
descriptions of simple objects like birds
representing many different classes.
External Document © 2019 Infosys Limited
Generated image
Colorful circle with blue
painting style
Generated image
Louvre painting with
impressionist style
Generated image
Persepolis in
Van Gogh style
· eGANs (Evolutionary Generative
Adversarial Networks) that generate
photographs of faces with different
ages, from young to old.
· IcGAN, to reconstruct photographs
of faces with specific features, such
as changes in hair color, style, facial
expression, and even gender.
Fine Grained Classification
Classification of an object into specific
categories such as car, table, flower and
such are common in Computer Vision.
However, establishing the objects’ finer
class, based on specific characteristics, is
where AI is making rapid progress. This is
because granular features of objects are
being trained and used for differentiation
of objects.
Examples of Fine Grained Classification are
In Fine Grained Classification, the
progression through the 8-layer CNN
network can be thought of as a progression
from low to mid to high-level features.
The later layers aggregate more complex
structural information across larger
scales–sequences of convolutional layers
Figure 5.0: Bird Recognition Pipeline Overview. Source: Branson, Van Hoen et al.: Bird Species Categorization
· Fine grained clothing style finder, type
of a shoe, etc.
· Recognizing a car type
· Recognizing breed of a dog, plant
species, insect, bird species, etc.
However, fine-grained classification is
challenging due to the difficulty of finding
discriminative features. Finding those
subtle traits that fully characterize the
object is not straightforward.
interleaved with max-pooling can capture
deformable parts, and fully connected
layers can capture complex co-occurrence
statistics.
Bird recognition is one of the major
examples in fine grained classification,
in the below image, given a test image,
Fine Grained Classification
Approaches
· Feature representations that better
preserve fine-grained information
· Segmentation-based approaches that
facilitate extraction of purer features,
and part/pose normalized feature
spaces
· Pose Normalization Schemes
groups of detected key points are used
to compute multiple warped image
regions that are aligned with prototypical
models. Each region is fed through a
deep convolutional network, and features
are extracted from multiple layers after
which they are concatenated and fed to a
classifier.
External Document © 2019 Infosys Limited
 Car Detection System using Fine
Grained Classification
The below pictures and steps depict fine
grained classification approach for car
detection system
a. Detects parts using a collection of
unsupervised part detectors.
b. Outputs a grid of discriminative
features (The CNN is learned with class
Figure 6.0: Car Detection System. Source: Learning Features and Parts for Fine-Grained Recognition
Capsule Network
Convolutional Network are so far the
defacto and well accepted algorithms to
work with image based datasets. They
work on the pixels of images using various
size filters (channels) by convolving, using
pooling techniques to bubble the stronger
features to derive colors, textures, edges
and shapes and establish structures
through lower to highest layers.
Given the face of a person, CNN identifies
the face by establishing eyes, ears,
eyebrows, lips, chin, etc. components
of the face. However, if the facial image
is provided with incorrect position and
External Document © 2019 Infosys Limited
labels and then truncated, retaining
the first two convolutional layers
that retain spatial information). The
appearance of each part detected
using the learned CNN features is
described by pooling in the detected
region of each part.
c. Appearance of any undetected part
is set to zero. This results in Ensemble
alignment of eyes, and eyebrows or say
eyebrows swaps with lips and ears are
placed on forehead, the same CNN trained
algorithm would still go on and detect this
as a human face. This is the huge drawback
of CNN algorithm and happens due to
its inability to store the information on
relative position of various objects.
Capsule Network, invented by Geoffery
Hinton, addresses exactly this problem of
CNN by storing the spatial relationships of
various parts.
Capsule Network like CNN are multi
layered neural networks, consisting of
of Localized Learned Features (ELLF)
representation which is then used to
predict fine-grained object categories.
d. A standard CNN passes the output
of the convolutional layers through
several fully connected layers in order
to make a prediction.
several capsules, each capsule consists
of several neurons. Capsules in lower
layers are called primary capsules and are
trained to detect an object (e.g. triangle,
circle) within a given region of image. It
outputs a vector that has two properties;
Length and Orientation. Length represents
the probability of the presence of the
object and Orientation represents the
pose parameters of the object such as
coordinates, rotation angle, etc.
Capsules in higher layers called routing
capsules, detect larger and more complex
objects, such as eyes, ears, etc.
 Figure 7.0: A simple CapsNet with 3 layers. This model gives comparable results to deep convolutional networks. Source: Dynamic
Routing Between Capsules, Sara Sabour, Nicholas Frosst, Geoffrey E. Hinton
Figure 8.0: Capsule Network for House or Boat classification. Source: Beginners’ Guide to Capsule Networks
Routing by Agreement
Unlike CNN which primarily bubbles higher
order features using max. or avg. pooling,
Capsule Network bubbles up features
using routing by agreement, where every
capsule participates in choosing the shape
by voting (democratic election way).
In the figure given above,
· Lower level corresponds to rectangles,
triangles and circles.
· High level corresponds to houses,
boats, and cars.
If there is an image of a house, the
capsules corresponding to rectangles
and triangles will have large activation
vectors. Their relative positions (coded
in their instantiation parameters) will bet
on the presence of high-level objects.
Since they will agree on the presence of
house, the output vector of the house
capsule will become large. This, in turn,
will make the predictions by the rectangle
and the triangle capsules larger. This
cycle will repeat 4-5 times after which the
bets on the presence of a house will be
considerably larger than the bets on the
presence of a boat or a car.
Advantage over CNN
· Less data for training - Capsule
Networks need very less data for
training (almost 10%) as compared to
CNN
· Fewer parameters: The connections
between layers require fewer
parameters as capsule groups neurons,
resulting in relatively less computations
bandwidth
· Preserve pose and position - They
preserve pose and position information
as against CNN
· High accuracy - Capsule Networks
have higher accuracy as compared to
CNNs
· Reconstruction vs mere classification
- CNN helps you to classify the images,
but not reconstruct the same image
whereas Capsule Networks help you to
reconstruct the exact image.
· Information retention vs loss - With
CNN, during edge detection, kernel
for edge detection works only on a
specific angle and each angle requires
a corresponding kernel. When dealing
with edges CNN works well, because
there are very few ways to describe
an edge. Once we get up to the level
of shapes, we do not want to have a
kernel for every angle of rectangles,
ovals, triangles, and so on. It would
get unwieldy, and would become
even worse when dealing with more
complicated shapes that have 3
dimensional rotations and features like
lighting, the reason why traditional
neural nets do not handle unseen
rotations effectively.
Capsule Networks are best suited for
object detection and image segmentation
while it helps better model hierarchical
relationships and provides high accuracy.
However, Capsule Networks are still under
research and relatively new and mostly
tested and benchmarked on MNIST
dataset, but they will be the future in
working with massive use cases emerging
from Vision datasets.
External Document © 2019 Infosys Limited
 Meta Learning
Traditional methods of learning in Machine
Learning focuses on taking a huge labeled
dataset and then learning to detect y
(dependent variable, say classifying an
image as cat or dog) and given set of x
(independent variables, images of cats
and dogs). This process involves selection
of an algorithm such as Convolution
Neural Net, and arriving at various hyper
parameters such as number of layers
in the network, number of neurons in
each layer, learning rate, weights, bias,
dropouts, activation function to activate
the neuron such as sigmoid, tanh and
Relu. The learning happens through
several iterations of forward and backward
passes (propagation) by readjusting (also
called learning) the weights based on
difference in the loss (actual vs computed).
At the minimal loss, the weights and
other network parameters are frozen
and are considered final model for future
prediction tasks. This is obviously a long
and tedious process and repeating this for
every use case or task is engineering, data,
and compute intensive.
Meta Learning focuses on how to learn to
learn. It is one of the fascinating discipline
of artificial intelligence. Human beings
have varying styles of learning. Some
Transfer Learning (TL)
Humans can learn from their own existing
experiences or experiences they have
heard, seen or observed. Transfer Learning
discipline of AI is based on similar traits of
human learning where new models can
learn and benefit from existing trained
model.
For example, if a Computer Vision based
detection model, with no Transfer
Learning, that already detects various
types of vehicles such as cars, trucks and
bicycles needs to be trained to detect an
airplane, then, you may have to retrain the
full model with images of all the previous
objects.
External Document © 2019 Infosys Limited
people learn and memorize with one
instance of visual or auditory scan. Some
people need multiple perspectives to
strengthen the neural connections for
permanent memory. Some remember by
writing while some remember through
actual experiences. Meta Learning tries
to leverage these to build its learning
characteristics.
Types of Meta-Learning Models
Like the variety in human learning
techniques, Meta Learning also uses
various learning methods based on
patterns of problems such as those based
on boundary space, amount of data, by
optimizing size of neural network or using
recurrent network approach. Each of these
are briefly discussed inline.
Few Shots Meta-Learning
This learning technique focuses on
learning from a few instances of data.
Typically, Neural Nets need millions of
data points to learn, however Few Shots
Meta- Learning uses only a few instances
of data to build models. Examples being
Facial recognition systems using Single
Shot Learning, this is explained in detail in
Single Shot Learning section.
However, with Transfer Learning, you can
introduce an additional layer on top of the
existing pre-trained layer to start detecting
airplanes.
Typically, in a no Transfer Learning
scenario, model needs to be trained and
during training right weights are arrived
at by doing many iterations (epochs) of
forward and back propagation, which takes
significant amount of computation power,
and time. In addition, Vision models need
significant amount of image data such as,
in this example, images of airplanes to be
trained.
Optimizer Meta-Learning
In this method, the emphasis is on
optimizing the neural network and its
hyper- parameters. A great example of
optimizer meta-learning are models that
are focused on improving gradient descent
techniques.
Metric Meta-Learning
In this learning method, the metric space
is narrowed down to improve the focus of
learning. Then the learning is carried out
only in this metric space by leveraging
various optimization parameters that are
established for the given metric space.
Recurrent Model Meta-Learning
This type of meta-learning model is tailored
to Recurrent Neural Networks(RNNs)
such as Long-Short-Term-Memory(LSTM).
In this architecture, the meta-learner
algorithm will train a RNN model to process
a dataset sequentially and then process
new inputs from the task. In an image
classification setting, this might involve
passing in the set of (image, label) pairs
of a dataset sequentially, followed by new
examples which must be classified. Meta-
Reinforcement Learning is an example of
this approach.
With Transfer Learning approach, you can
reuse the existing pre-trained weights of an
existing trained model, with significantly
less number of images ( 5 to 10 percent
of actual images needed for training
ground up model) for the model to start
detecting. As the pre-trained model has
already learnt some basic learning around
identifying edges, curves and shapes in the
earlier layers, it needs to learn only higher
order features specific to airplanes with
the existing computed weights. In brief,
Transfer Learning helps eliminate the need
to learn anything from scratch.
Transfer Learning helps in saving recognition model. usage is for experimentative purpose.
significant amount of data, computational
Another key thing during Transfer Learning Earlier, having used the human brain
power and time in training new models as
is that it is important to understand the rationale, it is important to note that,
they leverage pre-trained weights from the
details of the data on which new use cases human brains have gone through centuries
existing trained models and architectures.
are being trained; as it can implicitly push of experiences and gene evolution and has
However, it is important to understand
the built-in biases from the underlying data the ability to learn faster, whereas transfer
that Transfer Learning approach, today,
into newer systems. It is recommended learning is just a few decades old and is
is only matured enough to be applied to
that the datasheets of underlying models becoming ground for new vision and text
similar use cases, that is, you cannot use
and data be studied thoroughly unless the use cases.
the above discussed model to train a facial

Figure 9.0: Transfer Learning Layers. Source: John Cherrie, Training Deep Learning Models with Transfer Learning.

External Document © 2019 Infosys Limited

 Single Shot Learning
Humans have the impressive skill to reason
about new concepts and experiences with
just a single example. They have the ability
for one-shot generalization: the aptitude
to encounter a new concept, understand
its structure, and then generate compelling
alternative variations of the same.
Facial recognition systems are good
candidates for Single Shot Learning,
otherwise needing ten thousands of
individual face images to train one neural
network can be extremely costly, time
consuming and infeasible. However, a
Figure 10.0: Encoding approach inspired from ML Course from Coursera
External Document © 2019 Infosys Limited
Single Shot Learning based system using
existing pre-trained FaceNet model and
facial encoding based approach on top of
it can be very effective to establish face
similarity by computing distance between
the faces.
In this approach, 128 bit encoding of each
face image is generated and compared
with other image’s encoding to determine
if the person is same or different.
Various distance based algorithms such
as Euclidean distance can be used to
determine if they are within specified
threshold. The model training approach
involves creating pairs of (Anchor, Positive)
and (Anchor, Negative) and training the
model in a way where (Anchor, Positive)
pair distance difference is smaller and
(Anchor, Negative) distance is farther.
“Anchor” is the image of a person for whom
the recognition model needs to be trained.
“Positive” is another image of the same
person.
“Negative” is image of a different person.
Deep Reinforcement Learning (RL)
This is a specialized Machine Learning
discipline where an agent learns to behave
in an environment by getting reward or
punishment for the actions performed. The
agent can have an objective to maximize
short term or long-term rewards. This
discipline uses deep learning techniques to
State
Action
State
Figure 11.0: Schema inspired by the Q learning notebook by Udacity
Three Approaches to Reinforcement Learning
Value Based
In value-based RL, the goal is to optimize
the value function V(s). Qtable uses any
Expected
The agent will use this value function to
select which state to choose at each step.
Policy Based
In policy-based RL, we want to directly
optimize the policy function π(s) without
using a value function.
The policy is what defines the agent
behavior at a given time.
bring in human level performance on the robots, driverless car, etc.
given task.
In reinforcement learning, policy, p,
Deep Reinforcement Learning has found controls what action we should take. Value
significant relevance and application in function, v, measures how good it is to be
various game design systems such as in a particular state. The value function
creating video games, chess, alpha Go, tells us the maximum expected future
Atari, as well as in industrial applications of reward the agent will get at each state.
Qtable Q value
Q* learning
Q value action 1
Deep
Q Neural Q value action 2
network
Q value action 3
Deep Q* learning
mathematical function to arrive at a state of the reward an agent can expect to
based on action. accumulate over the future, starting at that
state.
The value of each state is the total amount
Reward
Given that state
discounted
There are two types of policies:
1. Deterministic: A policy which at a given
state will always return the same action.
2. Stochastic: A policy that outputs a
distribution probability over actions.
Value based and Policy based are more
action = policy(state)
conventional Reinforcement Learning
approaches. They are useful for modeling
relatively simple systems.
External Document © 2019 Infosys Limited
 Model Based
In model-based RL, we model the
environment. This means we create a
model of the behavior of the environment;
then this model is used to arrive at results
that maximises short term or long-term
rewards. The model equation can be
any equation that is defined based on
the environments behavior and must be
sufficiently generalized to counter new
situations.
When Model based approach uses Deep
Neural Network algorithms to sufficiently
well generalize and learn the complexities
of the environment to produce optimal
results, it is called Deep Reinforcement
Learning. The challenge with model based
Auto ML (AML)
Designing machine learning solution
involves several steps such as, collecting
data, understanding, cleansing and
normalizing data, doing feature
engineering, selecting or designing
the algorithm, selecting the model
architecture, selecting and tuning model’s
hyper-parameters, evaluating model’s
performance, deploying and monitoring
the machine learning system in an online
system and so on. Such machine learning
solution design requires an expert Data
Scientist to complete the pipeline.
Hand-crafted
portfolio
{ Xtrain, Ytrain,
Xtest, budget }
Figure 12.0: An example of Auto sklearn pipeline. Source: André Biedenkapp, We did it Again: World Champions in AutoML
External Document © 2019 Infosys Limited
approach is, each environment needs a
dedicated trained model.
AlphaGo was trained by using data from
several games to beat the human being
in the game of Go. The training accuracy
was just 57% and still it was sufficient to
beat the human level performance. The
training methods involved reinforcement
learning and deep learning to build a
policy network that tells what moves are
promising, and a value network that tells
how good the board position is. Searches
for the final move from these networks
is done using Monte Carlo Tree Search
(MCTS) algorithm. Using supervised
learning, a policy network was created to
imitate the expert moves.
As the complexity of these and other tasks
can easily get overwhelming, the rapid
growth of machine learning applications
has created a demand for off-the-shelf
machine learning methods that can be
used easily and without expert knowledge.
The AI research area that encompasses
progressive automation of machine
learning pipeline tasks is called AutoML
(Automatic Machine Learning).
Google CEO Sundar Pichai wrote,
“Designing neural nets is extremely time
Bayesian Optimization
Meta
Data Feature
Learning
Processor Preprocessor
Deep Mind released AlphaGo Zero in late
2017 which beat AlphaGo and did not
involve any training from previous games
data to train deep network. The deep
network training was done by picking
the training samples from AlphaGo and
AlphaGo Zero playing games against
itself and selecting best moves to train
the network and then applying those
in real games to improve the results
iteratively. This is possible because deep
reinforcement learning algorithms can
store long-range tree search results for the
next best move in memory and do very
large computations that are difficult for a
human brain.
intensive, and requires an expertise that
limits its use to a smaller community of
scientists and engineers. That’s why we’ve
created an approach called AutoML,
showing that it’s possible for neural nets
to design neural nets” while Google’s
Head of AI, Jeff Dean, suggested that 100x
computational power could replace the
need for machine learning expertise.
AutoML Vision relies on two core
techniques: transfer learning and neural
architecture search.
AutoML system
Build
Ytest,
Classifier Ensemble
ML Pipeline
Implementing AutoML
Here is a look at the few libraries that help
in implementing AutoML
AUTO-SKLEARN
AUTO SKLEARN automates several key
tasks in Machine Learning pipeline such
as addressing column missing values,
encoding of categorical values, data scaling
and normalization, feature pre-processing,
and selection of right algorithm with
hyper-parameters. The pipeline supports
15 Classification and 14 Feature processing
algorithms. Selection of right algorithm can
happen based on ensembling techniques
and applying meta knowledge gathered
from executing similar scenarios (datasets
and algorithms).
Usage
Auto-sklearn is written in python and can
be considered as replacement for scikit-
learn classifiers. Here is a sample set of
commands.
>>> import autosklearn.classification
>>> cls = autosklearn.classification.
AutoSklearnClassifier()
>>> cls.fit(X_train, y_train)
>>> predictions = cls.predict(X_test,
y_test)
SMAC (Sequential Model-Based
Algorithm Configuration)
SMAC is a tool for automating certain
AutoML steps. SMAC is useful for selection
of key features, hyper-parameter
optimization and to speed up algorithmic
outputs.
BOHB (Bayesian Optimization
Hyperband searches)
BOHB combines Bayesian hyper parameter
optimization with bandit methods for
faster convergence.
Google, H2O also have their respective
AutoML tools which are not covered here
but can be explored in specific cases.
AutoML needs significant memory and
computational power to execute alternate
algorithms and compute results. At
present, GPU resources are extremely
costly to execute even simple Machine
Learning workloads such as CNN algorithm
to classify objects. If multiple such
alternate algorithms should be executed,
the computation dollar needed would be
exponential. This is impractical, infeasible
and inefficient for the current state of Data
Science industry. Adoption of AutoML will
depend on two things, one, the maturity
of AutoML pipeline and second but more
important, how quickly GPU clusters
become cheap. The second being most
critical. Selling Cloud GPU capacity could
be one of the motivation of several cloud
based infrastructure-running companies
to promote AutoML in the industry. Also,
AutoML will not replace the Data scientist’s
work but can provide augmentation
and speed to certain tasks such as data
standardization, model tuning and
trying multiple algorithms. It is only the
beginning for AutoML but this technique
has high relevance and usefulness for
solving ultra-complex problems.
External Document © 2019 Infosys Limited
 Neural Architecture Search (NAS)
Neural Architecture Search (NAS) is a
component of AutoML and addresses
the important step of designing Neural
Network Architecture.
Designing fresh Neural Net architecture
involves an expert establishing and
organizing Neural Network layers, filters
or channels, filter sizes, selecting other
optimum Hyper parameters and so on
through several rounds of computational
iterations. Since AlexNet deep neural
network architecture won the ImageNet
(image classification based on ImageNet
dataset) competition in 2012, several
architecture styles such as VGG, ResNet,
Inception, Xception, InceptionResNet,
MobileNet and NASNet have significantly
evolved. However, selection of the right
architecture for the right problem is also
a skill due to the presence of various
influencers such as applicability to the
problem, accuracy, number of parameters,
memory and computational footprint and
size of the architecture that govern the
overall functioning efficiency.
Neural Architecture Search tries to address
this problem space by automatically
selecting right Neural Network architecture
to solve a given problem.

AutoML

Hyperparameter
Optimization

NAS

Figure 13.0: Source: Liam Li, Ameet Talwalkar, What is neural architecture search

External Document © 2019 Infosys Limited

Key Components of NAS
Search Space
DAG Representation
Cell Block
Meta-Architecture
Figure 14.0: Components of NAS. Source: Liam Li, Ameet Talwalkar, What is neural architecture search.
Search space: The search space provides
boundary within which the specific
architecture needs to be searched.
Computer Vision (captioning the scene,
or product identification) based use
cases would need a different neural
network architecture style, as against
Speech (speech transcription, or speaker
classification) or unstructured Text (Topic
extraction, intent mining) based use cases.
Search space tries to provide available
catalogs of best in class architectures based
on other domain data and performance.
Components of NAS
Optimization
Method
Reinforcement Learning
Evolutionary Search
Gradient-Based
Optimization
Network Morphism
Bayesian
Optimization
These are also usually hand crafted by
expert data scientists.
Optimization method: This is responsible
for providing mechanism to search the
best architecture. It could be searched
and applied randomly or using certain
statistical or Machine Learning evaluation
approach such as Bayesian method or
reinforcement learning methods.
Evaluation method: This has the role
of evaluating the quality of architecture
considered by optimization method. It
Evaluation
Method
Full Training
Partial Training
Weight-Sharing
NAS Specific
Hypernetworks
could be done using full training approach
or doing partial training and then applying
certain specialized methods such as partial
training or early stopping, weights sharing,
network morphism, etc.
For selective problem spaces, as
compared to manual methods, NAS have
outperformed and is showing definite
promise for future. However, it is still
evolving and not ready for production
usages as several architectures need to be
established and evaluated depending on
the problem space.
External Document © 2019 Infosys Limited
 Addressing H3 AI Trends at Infosys
In this paper, we looked at some key H3 AI
areas; by no means this is an exhaustive
list. Amongst all discussed, Transfer
Learning, Capsule Networks, Explainable
AI, Generative AI are making interesting
# Trend
1 Explainable AI (XAI)
Generative AI, Neural Style
2
Transfer (NST)
3 Fine Grained Classification
4 Capsule Networks
5 Meta Learning
6 Transfer Learning
7 Single Shot Learning
Deep Reinforcement Learning
8
(RL)
9 Auto ML
10 Neural Architecture Search (NAS)
External Document © 2019 Infosys Limited
things possible and looks highly promising. interesting client problems. Here is a look
We are keenly experimenting with these, at how we are employing these H3 trends
building early use cases, and integrating in the work we do.
into our product stack Infosys Enterprise
Cognitive platform (iECP) to solve
Use cases
Applicable across where results need to be traced e.g. Tumor
Detection, Mortgage Rejection, Candidate Selection, etc.
Art Generation, Sketch Generation, Image or Video Resolution
Improvements, Data Generation/Augmentation, Music Generation
Vehicle Classification,
Type of Tumor Detection
Image Re-construction,
Image Comparison/Matching
Intelligent Agents, Continuous Learning scenarios
for document review and corrections.
Identifying person not wearing helmet Logo/brand detection in the
image Speech Model training for various accents, vocabularies
Face Recognition, Face Verification
Intelligent Agents, Robots, Driverless cars, Traffic Light Monitoring,
Continuous Learning scenarios for document review and corrections
Invoice Attribute Extraction,
Document Classification, Document Clustering
CNN or RNN based use cases such as Image Classification, Object
Identification, Image Segmentation, Speaker Classification, etc.
Table 2.0: AI Use cases, Infosys Research
Reference:
1. Explainable AI (XAI)
• https://christophm.github.io/interpretable-ml-book/

• https://simmachines.com/explainable-ai/

• https://www.cmu.edu/news/stories/archives/2018/october/explainable-ai.html

• https://medium.com/@QuantumBlack/making-ai-human-again-the-importance-of-explainable-ai-xai-95d347ccbb1c

• https://towardsdatascience.com/explainable-artificial-intelligence-part-2-model-interpretation-strategies-75d4afa6b739

2. Fine Grained Classification

• https://vision.cornell.edu/se3/wp-content/uploads/2015/02/BMVC14.pdf

3. Capsule Networks
• https://arxiv.org/pdf/1710.09829.pdf

• https://keras.io/examples/cifar10_cnn_capsule/

• https://www.youtube.com/watch?v=pPN8d0E3900

• https://www.youtube.com/watch?v=rTawFwUvnLE

• https://medium.freecodecamp.org/understanding-capsule-networks-ais-alluring-new-architecture-bdb228173ddc

4. Meta Learning
• https://medium.com/@jrodthoughts/whats-new-in-deep-learning-research-openai-s-reptile-makes-it-easier-to-learn-how-to-learn-
e0f6651a39f0

• http://proceedings.mlr.press/v48/santoro16.pdf

• https://towardsdatascience.com/whats-new-in-deep-learning-research-understanding-meta-learning-91fef1295660

5. Transfer Learning
• https://www.fast.ai/2018/07/23/auto-ml-3/

6. Single Shot Learning

• https://arxiv.org/pdf/1603.05106.pdf

7. Deep Reinforcement Learning (RL)

• https://deepmind.com/blog/article/deep-reinforcement-learning

• https://medium.freecodecamp.org/an-introduction-to-reinforcement-learning-4339519de419

• https://medium.com/@jonathan_hui/alphago-zero-a-game-changer-14ef6e45eba5

• https://arxiv.org/pdf/1811.12560.pdf

8. Auto ML
• https://www.ml4aad.org/automated-algorithm-design/algorithm-configuration/smac/

• https://www.fast.ai/2018/07/23/auto-ml-3/

• https://www.fast.ai/2018/07/16/auto-ml2/#auto-ml

• https://competitions.codalab.org/competitions/17767

• https://www.automl.org/automl/auto-sklearn/

• https://www.ml4aad.org/automated-algorithm-design/algorithm-configuration/smac/

• https://automl.github.io/HpBandSter/build/html/optimizers/bohb.html

External Document © 2019 Infosys Limited

9. Neural Architecture Search (NAS)
• https://www.oreilly.com/ideas/what-is-neural-architecture-search

10. Infosys Enterprise Cognitive Platform

• https://www.infosys.com/services/incubating-emerging-technologies/offerings/Pages/enterprise-cognitive-platform.aspx

About the author

Sudhanshu Hate is inventor and architect of Infosys Enterprise Cognitive Platform (iECP),
a microservices API based Artificial Intelligence platform. He has over 21 years of experience
in creating products, solutions and working with clients on industry problems. His current
areas of interests are Computer Vision, Speech and Unstructured Text based AI possibilities.

To know more about our work on the H3 trends in AI, write to icets@infosys.com.

For more information, contact askus@infosys.com

© 2019 Infosys Limited, Bengaluru, India. All Rights Reserved. Infosys believes the information in this document is accurate as of its publication date; such information is subject to change without notice. Infosys
acknowledges the proprietary rights of other companies to the trademarks, product names and such other intellectual property rights mentioned in this document. Except as expressly permitted, neither this
documentation nor any part of it may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, printing, photocopying, recording or otherwise, without the
prior permission of Infosys Limited and/ or any named intellectual property rights holders under this document.

Infosys.com | NYSE: INFY Stay Connected