Beruflich Dokumente
Kultur Dokumente
In their neverending quest for better accuracy, researchers often scale up their
convolutional neural networks (CNNs) by arbitrarily increasing their depth or width or
using larger input image resolutions for training and evaluation. These methods
however require manual tuning and can still fail to optimize performance. Might there
be a more efficient approach to scaling up CNNs to improve accuracy?
Researchers from Google AI say “yes” and have proposed a new model scaling method
in their ICML 2019 paper EfficientNet: Rethinking Model Scaling for Convolutional Neural
Networks. This method uses a simple but effective compound coefficient to scale up
CNNs in a more principled manner. It uniformly scales each dimension with a fixed set
of scaling coefficients.
https://medium.com/syncedreview/google-ai-efficientnets-improve-cnn-scaling-43ffbee3d521 1/5
07/11/2019 Google AI ‘EfficientNets’ Improve CNN Scaling - SyncedReview - Medium
To better understand the effect of network scaling, researchers studied the impact of
scaling different model dimensions. Results show the best way to improve overall
performance is to balance network dimensions such as width, depth, and image
resolution against available network resources.
This compound scaling method first performs a grid search to find the relationship
between different scaling dimensions of the baseline network under a fixed resource
constraint, which determines the scaling coefficient for each dimension. It then applies
these coefficients to scale up the baseline network to the desired target model size or
computational budget.
https://medium.com/syncedreview/google-ai-efficientnets-improve-cnn-scaling-43ffbee3d521 2/5
07/11/2019 Google AI ‘EfficientNets’ Improve CNN Scaling - SyncedReview - Medium
Researchers compared EfficientNets with other CNNs on ImageNet. Results show that
EfficientNet models achieve both higher accuracy and better efficiency. Moreover,
experiments showed that EfficientNets also transfer well on eight widely used transfer
learning datasets.
The paper EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks is on
arXiv. All the relevant source code and TPU training scripts is open sourced at GitHub.
. . .
https://medium.com/syncedreview/google-ai-efficientnets-improve-cnn-scaling-43ffbee3d521 3/5
07/11/2019 Google AI ‘EfficientNets’ Improve CNN Scaling - SyncedReview - Medium
. . .
. . .
. . .
We know you don’t want to miss any stories. Subscribe to our popular Synced Global
AI Weekly to get weekly AI updates.
https://medium.com/syncedreview/google-ai-efficientnets-improve-cnn-scaling-43ffbee3d521 4/5
07/11/2019 Google AI ‘EfficientNets’ Improve CNN Scaling - SyncedReview - Medium
https://medium.com/syncedreview/google-ai-efficientnets-improve-cnn-scaling-43ffbee3d521 5/5