Beruflich Dokumente
Kultur Dokumente
For the third year in a row, after 2006 and 2007, ipoque has conducted a compre-
hensive study measuring and analyzing Internet traffic in eight regions of the world.
The study includes statistical data about popularity and user behavior for all common
network protocols. This covers most applications used in today’s Internet such as
Web browsing, media streaming, P2P file sharing, one-click file hosting, instant mes-
saging, Internet telephony and online games. BitTorrent and eDonkey downloads
have been analyzed to classify the transfered files according to their content type.
Some of the key findings are: P2P still produces most Internet traffic worldwide al-
though its proportion has declined across all monitored regions – loosing users to file
hosting and media streaming; regional variations in application usage are very
prominent; and Web traffic has made its comeback due to the popularity of file host-
ing, social networking sites and the growing media richness of Web pages.
1
ipoque’s P2P Survey 2006 and Internet Study 2007 are available at http://www.ipoque.com/resources/internet-studies.
Internet Study 2008/2009
The time period of the measurements was shortened from The following table list the proportion of the overall network
an average of four weeks to two weeks. While two weeks traffic generated by the respective protocol class. A good
are long enough to get a snapshot of the user behavior, quality indicator for these results is the amount of unclassi-
even four weeks would have been too short to discern fied traffic, which is below 10 percent for all but one re-
broader trends. So this has no impact on the validity of the gion. In Northern Africa, tunnel protocol support was not
results, but reduces the data collection and analysis effort. licensed by the customer and thus disabled in the PRX Traf-
fic Manager – thus the high value of 14 percent.
Due to the ongoing improvement of ipoque’s protocol sup-
port, more different protocols and applications are covered Peer-to-peer file sharing (P2P) still generates by far the most
in this study, including encrypted and unencrypted tunnel- traffic in all monitored regions – ranging from 43 percent in
ing, streaming and Internet TV. 1 Northern Africa to 70 percent in Eastern Europe. The re-
gional differences can probably be attributed to varying
For the first time, we have recorded the average packet
subscriber access bandwidth, availability of localized con-
size for all protocols – separately for downstream and up-
tent, and cultural habits. Interestingly, the two Arab regions,
stream traffic. This analysis is only available for South
Northern Africa and the Middle East, share a consistently
America.
lower P2P ratio. This is compensated by a comparably
Content Type Classification higher proportion of Web traffic.
The content type analysis, that looks at what kind of files
Protocol class proportions 2008/2009
are shared in P2P networks, is limited to only a few of the
measurement sites – mostly due to privacy concerns – and Protocol Southern South Eastern Northern Germany Southern Middle South-
covers two regions: Germany and Southern Europe. The Class Africa America Europe Africa Europe East western
Europe
same methodology as in the previous studies is used.
P2P 65,77% 65,21% 69,95% 42,51% 52,79% 55,12% 44,77% 54,46%
In our 2006 P2P study1, we introduced this semi-automatic Web 20,93% 18,17% 16,23% 32,65% 25,78% 25,11% 34,49% 23,29%
content type classification procedure for files shared Streaming 5,83% 7,81% 7,34% 8,72% 7,17% 9,55% 4,64% 10,14%
through the BitTorrent and eDonkey networks. For eDonkey, VoIP 1,21% 0,84% 0,03% 1,12% 0,86% 0,67% 0,79% 1,67%
the classification is mostly based on file name keywords IM 0,04% 0,06% 0,00% 0,02% 0,16% 0,03% 0,50% 0,08%
combined with a manual classification of the most popular Tunnel 0,16% 0,10% – – – 0,09% 2,74% –
titles. The BitTorrent classification mostly relied on meta data Standard 1,31% 0,49% – 0,89% 4,89% 0,52% 1,83% 1,23%
available on various large BitTorrent tracker or repository Gaming – 0,04% – – 0,52% 0,05% 0,15% –
Unknown 4,76% 7,29% 6,45% 14,09% 7,84% 8,86% 10,09% 9,13%
sites such as The Pirate Bay2 and Mininova 3. Over the last
two years, the importance has gradually shifted towards
BitTorrent. Unfortunately, the automatic classification has
Distribution of protocol classes 2008/2009
become more complicated. While the same approach still
generally works, it requires a far greater effort due to an
exploding number of tracker sites – many of them offering S. Africa 66% 21% 6% 5%
local-language content making the classification more diffi- S. America 65% 18% 8% 7%
cult. With the tracker sites included for our 2007 study we E. Europe 70% 16% 7% 6%
were able to classify 55 percent of all transfered files rep-
Germany 53% 26% 7% 8%
resenting 70 percent of all BitTorrent traffic. This time we
S. Europe 55% 25% 10% 9%
were only able to classify about 30 percent of all files and
close to 50 percent of the traffic volume using the same Middle East 45% 34% 5% 10%
tracker sites. N. Africa 43% 33% 9% 14%
Sw. Europe 54% 23% 10% 9%
1
A complete list of the supported protocols is available on our Web site at http://www.ipoque.com/products/protocol-support.
2
The Pirate Bay: http://thepiratebay.org
3
Mininova: http://www.mininova.org
2 © ipoque 2009
Internet Study 2008/2009
Trends and Regional Differences The Middle East maintained its comparably high level of
Web traffic of 35 percent. Media streaming has jumped
The proportion of P2P has decreased in all regions. It is
from virtually non-existent to nearly 5 percent. Most likely
important to note, though, that this does not mean there is
this can be attributed to higher access speeds which have
less P2P traffic than one year ago, but only that P2P has
made this application possible only during the last year.
grown slower than other traffic. Unfortunately, most of the
The same is true, to a lesser degree, about VoIP (plus 40
measurement points participating in this study changed
percent) and IM, which doubled. In Germany, the propor-
compared to 2006 and 2007 making a comparison with
tion of these two applications has decreased, which could
previous results only possible for Germany and the Middle
be caused by stagnating user numbers keeping traffic levels
East.
constant.
Protocol class proportions 2008/2009 versus 2007
Thunder 9%
79,8%
Web iMesh 9%
-0,6%
Flash 4%
BitTorrent 20%
-50,0%
IM
106,5% eDonkey 17%
HTTP 10%
-75,0% -25,0% 25,0% 75,0% 125,0% 175,0%
File hosting 8%
Eastern Europe Germany Middle East Southwestern Europe Flash 6%
3 © ipoque 2009
Internet Study 2008/2009
HTTP 24%
HTTP 13%
File hosting 9%
DirectConnect 13%
eDonkey 7%
Flash 5%
GRE 2%
File hosting 3% Flash 1%
Flash 5% Flash 7%
Germany
is the only region with significant
User Number Statistics
Usenet traffic
Key Facts
BitTorrent 37%
• HTTP used by over 90% of all network nodes
HTTP 15%
• Very high number of P2P users in South America
eDonkey 13% • Strong concentration on a few applications among
university users
File hosting 10%
BitTorrent 27% The following table lists the proportion of unique network
users per protocol. Users are identified by their IP address
eDonkey 26% and thus not only include client programs operated by a
HTTP 15% human being, but also application servers. Dynamic IP ad-
dresses are automatically mapped to a fixed user identifier
File hosting 10% so that a network node is only counted once even it uses
dynamic IP addresses.
Flash 7%
In both regions, HTTP is the most-used protocol. The higher
0% 8% 15% 23% 30% number in South America can be explained by a lower
relative number of server machines run by the mostly resi-
4 © ipoque 2009
Internet Study 2008/2009
dential ISP subscribers compared to the university. At the Another noteworthy observation for South America is the
university, only three protocols are used by more than 10 high number of hosts that send DNS messages. Depending
percent of the network nodes – HTTP, Skype and BitTorrent on where PRX Traffic Manager is installed in the network, it
– while at the commercial ISP, 27 protocols get beyond this should see either close to 100 percent of hosts using DNS
threshold. Overall, the variety of applications is considera- (if the DNS server is on the external side of the system) or
bly higher for the IPS users where we have detected 78 close to zero percent (the more common case where hosts
different protocols versus 50 at the university. and DNS server reside both on the internal side). This is
what we observe at the university network, where PRX has
It is striking how popular P2P file sharing is in South Amer-
seen DNS messages for 7.55 percent of all hosts – which
ica. While we recorded only about 20 percent P2P users in
apparently use an external DNS server. At the ISP, PRX sees
our previous study, a number supported by other studies as
DNS traffic for nearly half of all hosts. Most likely, the ISP
well, it is much higher at the South American ISP. There are
operates several load-balancing DNS servers on both sides
four P2P protocols used by more than 10 percent of the
of PRX Traffic Manager.
subscribers – Ares, BitTorrent, eDonkey and Gnutella. The
worldwide most popular protocols BitTorrent and eDonkey
are both used by nearly 40 percent. Ares has an unusually
P2P Protocols
high popularity in this region with a 64 percent user base.
One possible reason could be the availability of Spanish
Key Facts
and Portuguese language content, but this is no sufficient
explanation because there is no similar Ares user base in • Lower proportion of P2P across all regions
Southwestern Europe. • BitTorrent by far the most popular P2P protocol
• eDonkey still second, but much lower than last year
Relative user numbers per protocol • Significant amount of Gnutella, iMesh, Thunder and
for South America and one German university DirectConnect traffic in some regions
5 © ipoque 2009
Internet Study 2008/2009
RapidShare, Megaupload) and the Usenet (often using also to alternative file sharing systems, mainly Web-based
commercial services such as UseNeXT). A reliable substitu- file hosting sites and the Usenet.
tion analysis (i.e. who is moving away from a service to
one or several new ones, and for what reasons) would only Trends and Regional Differences
be possible with a representative poll and is beyond the
BitTorrent has the biggest share in Eastern Europe and the
scope of this study.
Middle East with about 80 percent. It has its lowest popu-
larity in South America with only 30 percent. In all other
Most popular P2P protocols
regions, at least half of all P2P traffic is BitTorrent. Four
Protocol Southern South Eastern Northern Germany Southern Middle South- regions significantly deviate from the usual BitTorrent/
Africa America Europe Africa Europe East western eDonkey dominance. Northern Africa has only 8 percent
Europe
eDonkey, but over 14 percent Gnutella traffic. In Eastern
All P2P 65,77% 65,21% 69,95% 42,51% 52,79% 55,12% 44,77% 54,46%
Europe, it is DirectConnect with 18 percent, that replaces
Ares 0,29% 42,63% 0,00% 2,24% 0,84% 0,16% 0,11% 1,80%
eDonkey. South America has an unusually high share of
BitTorrent 48,34% 30,02% 80,83% 74,51% 70,77% 48,94% 78,85% 58,20%
DirectConnect 0,01% 0,00% 17,87% 0,08% 0,85% 0,00% 0,12% 0,30%
Ares traffic of 43 percent. In all other regions, Ares is less
eDonkey 2,48% 25,99% 1,16% 7,70% 24,22% 47,17% 15,37% 35,99% than 2 percent of all P2P. In Southern Africa, we have ob-
Gnutella 18,60% 0,36% 0,14% 14,21% 1,75% 1,66% 5,00% 2,75% served a nearly equal share of around 15 percent for
iMesh 13,60% 0,02% 0,00% 0,47% 0,00% 0,03% 0,00% 0,14% Gnutella, iMesh and Thunder. Thunder is a Chinese P2P
Thunder 14,04% 0,80% 0,00% 0,69% 0,77% 1,64% 0,52% 0,62% network that is apparently used by Chinese immigrants
Other 2,64% 0,19% 0,00% 0,10% 0,68% 0,41% 0,03% 0,21% living in South America.
1
See ipoque’s white paper “Copyright Protection in the Internet” for a detailed comparison of countermeasures against the sharing of
copyright-protected material in P2P networks available at http://www.ipoque.com/resources/white-papers.
6 © ipoque 2009
Internet Study 2008/2009
Encryption and Obfuscation in P2P Networks Southern Europe. The German data set was gathered at a
large university, the other at an ISPs.
Many modern P2P clients offer various forms of obfuscation
and encryption. The common claim that this is meant to The popularity of video downloads is consistent with last
improve the privacy of P2P users is plain dishonest. Even if year’s results. Between 58 percent (BitTorrent, Germany)
encryption is enabled, files are still shared with the general and 86 percent (eDonkey, Southern Europe) of all P2P traf-
public, so for everybody to download and store unen- fic, and between 44 percent (eDonkey, Germany) and 77
crypted. This is also why encryption does not provide any percent (BitTorrent, Southern Europe) of all transferred files
protection against copyright investigations in P2P networks, are videos. Drilling down to subcategories, movies are most
where investigators use normal P2P clients to participate in popular ranging from 16 (BitTorrent, Germany) to 62 (Bit-
the network and download files from potential infringers. Torrent, Southern Europe) percent by volume and 6 (eDon-
The only sensible reason for encryption is the attempt to key, Germany) and 67 (BitTorrent, Southern Europe) per-
circumvent bandwidth limitations imposed for P2P transfers cent by number of files.
by the ISP. However, with modern traffic management sys-
tems, which are able to reliably detect obfuscated and en-
crypted P2P traffic, this measure is totally ineffective. BitTorrent content type distribution
Southern Europe
Traffic volume
Proportion of encrypted and unencrypted BitTorrent and
eDonkey traffic in Germany and Southern Europe Porn
1,1% TV
Region BitTorrent eDonkey Anime
4,0%
encrypted unencrypted encrypted unencrypted 5,0% Music
Germany 22,81% 77,19% 16,08% 83,92% 4,1%
Southern Europe 26,21% 73,79% 7,03% 92,97%
7 © ipoque 2009
Internet Study 2008/2009
BitTorrent content type distribution The second-most popular category for BitTorrent is software
Germany (university) ranging from 24 (Southern Europe) to 41 (Germany) per-
Traffic volume cent traffic volume and 17 (Southern Africa) to 38 (Ger-
many) percent of all files. The by far most popular subcate-
Anime Music
TV gory is games. For eDonkey, software is below about 10
6,9% 1,2%
15,4% percent of the traffic volume.
Movie
The ratio between volume and number of files for video 20,0%
content is close to one for BitTorrent and about 1.5 for
eDonkey. This does not mean that eDonkey video files are
on average larger than BitTorrent ones (in fact, BitTorrent
eBook
files tend to be larger), but that fewer unique files are
3,2%
downloaded more often via BitTorrent. This is due to the
higher administrative overhead involved in sharing a file Other Porn
9,0% 14,4%
through BitTorrent.
TV
For the ‘movies’ subcategory, the BitTorrent ratio is again 11,8%
close to one, while for eDonkey it is even greater, with 2 in
Southern Europe and 4.5 at the German university, again Video 55% Audio 35% Software 5%
hinting at larger or higher-quality files. eBook 3% Other 2%
8 © ipoque 2009
Internet Study 2008/2009
9 © ipoque 2009
Internet Study 2008/2009
cations. This category was not supported in last year’s across all regions as for instance for P2P. Even an exotic
study, so we need to compare the sum of SIP and IM-VoIP messaging service like the Chinese QQ generates 44 per-
against last year’s SIP numbers. Comparative values are cent of all IM in Southern Africa, most likely due to a large
available for Germany and the Middle East. In Germany, Chinese minority living and working there.
there was less than 2 percent SIP traffic in 2007, compared
to over 70 percent in 2008. VoIP numbers in the Middle Traffic distribution of instant messaging protocols
East have remained fairly constant with a negligible decline
Protocol Southern South Eastern Northern Germany Southern Middle South-
from 14 to 13 percent. Africa America Europe Africa Europe East western
Europe
Skype is the most popular VoIP protocol in Eastern Europe
All IM 0,04% 0,06% 0,00% 0,02% 0,16% 0,03% 0,50% 0,08%
and the Middle East with bandwidth shares larger than 80
IRC 1,50% 56,57% 18,32% 11,16% 15,36% 17,90% 0,04% 57,21%
percent. Skype appears to be particularly popular in places QQ 43,88% 0,27% 0,45% 2,87% 0,44% 0,60% 0,14% 1,44%
with lower Internet access speed due to its dynamic audio XMPP 2,53% 1,54% 16,63% 20,29% 8,64% 6,35% 25,31% 2,15%
codec that adapts to varying bandwidth availability. MSN 26,84% 20,29% 19,65% 34,87% 3,61% 21,22% 0,24% 31,23%
OSCAR 0,48% 2,78% 41,80% 12,36% 57,80% 6,30% 3,65% 1,09%
Unchanged since 2007, the IP PBX interchange protocols
Yahoo 24,47% 18,56% 3,15% 18,41% 13,64% 47,62% 70,61% 6,85%
IAX and IAX2, included in ‘Other’ in the table below, have
Other 0,30% 0,00% 0,00% 0,04% 0,52% 0,00% 0,00% 0,01%
no practical significance. H.323 only shows up in Northern
Africa with 1 percent and in the Middle East with 6 per- S. Africa
cent. S. America
E. Europe
Traffic distribution of Internet telephony protocols 1 N. Africa
Protocol Southern South Eastern Northern Germany Southern Middle South- Germany
Africa America Europe Africa Europe East western S. Europe
Europe Middle East
All VoIP 1,21% 0,84% 0,03% 1,12% 0,86% 0,67% 0,79% 1,67%
Sw. Europe
H.323 0,03% 0,00% 0,00% 1,19% 0,09% 0,23% 6,20% 0,12%
0% 25% 50% 75% 100%
SIP+RTP 40,45% 49,55% 12,02% 31,54% 39,97% 38,11% 6,39% 44,40%
Skype 42,35% 20,51% 87,98% 48,84% 29,33% 32,08% 80,97% 32,23%
IRC QQ XMPP MSN OSCAR Yahoo Other
IM-VoIP 17,16% 29,94% – 18,40% 30,60% 29,58% 6,42% 23,24%
Other 0,01% 0,00% 0,00% 0,03% 0,01% 0,00% 0,01% 0,00%
H.323 SIP+RTP Skype IM-VoIP Other Both the Microsoft (MSN) and Yahoo Messengers have a
ratio of close to 1. OSCAR, that is used by AOL’s instant
messaging systems ICQ and AIM, is known to be used for
file transfers and thus shows a slightly larger ratio of 1.58.
Instant Messaging
For the XMPP protocol, also known as Jabber and used, for
instance, by Google Talk, it is only 0.16, meaning that
Key Facts
there is much less traffic per users. At the time of the meas-
• No single most popular protocol urement, file transfers with Google Talk and other XMPP
• Higher local popularity variance as for other proto- clients were nearly impossible, which explains the low per-
cols user data volume. IRC is often used for file sharing as an
• High per-user volume for IRC due to file exchange alternative to P2P. Unsurprisingly, IRC exhibits a much
higher per-user traffic than all other IM protocols with a
Each of the six major instant messaging (IM) protocols show
ratio close to 5.
a significant popularity (more than 20 percent of all IM
traffic) in at least one region. There is no clear leader
1
The PRX Traffic Manager in Eastern Europe was running an outdated firmware version, thus this value is not available there.
10 © ipoque 2009
Internet Study 2008/2009
1
Alexa Internet is a company gathering Web site usage data to generate a popularity ranking. http://www.alexa.com.
2
Note that HTTPS detection was only activated in five out of the eight monitored regions.
11 © ipoque 2009
Internet Study 2008/2009
Salesforce.com, only generates little traffic – between 1 Traffic distribution of tunneling protocols
and 3.2 percent.
Protocol Southern Africa South America Southern Europe Middle East
File hosting sites such as RapidShare and Megaupload All tunnels 0,16% 0,10% 0,09% 2,74%
generate a substantial amount of Web traffic – between 12 GRE 15,01% 1,71% 2,23% 86,01%
percent in Southern Africa and 44 percent in South Amer- OpenVPN 40,92% 93,20% 88,03% 0,28%
ica – contributing up to 10 percent to the overall Internet Tor 0,55% 0,00% 1,27% 0,03%
IPsec 43,52% 5,09% 8,47% 13,67%
traffic. File hosting services are mainly used to share and
download large files. Due to privacy concerns, this study
S. Africa
does not include the ranking of the various file hosting serv-
S. America
ices as in the 2007 study. Assuming a similar traffic distri-
S. Europe
bution among file hosting sites as last year, it is fair to say
Middle East
that RapidShare alone is responsible for 5 percent of the
worldwide Internet traffic. 0% 25% 50% 75% 100%
1
UseNeXT: http://www.usenext.com
12 © ipoque 2009
Internet Study 2008/2009
Traffic distribution of standard protocols (FTP, HTTP, POP3) have large downstream and small up-
stream packets.
Protocol Southern South Northern Germany Southern Middle Southwest-
Africa America Africa Europe East ern Europe
But some results appear to be more unusual. QQLive, a P2P
All standard 1,31% 0,49% 0,89% 4,89% 0,52% 1,83% 1,23%
protocols streaming protocol, has extremely large average upstream
DHCP 4,62% 0,00% 0,00% 0,00% 0,00% 0,00% 0,00% packets of 1,034 bytes on average. No other protocol
DNS 6,20% 2,01% 10,95% 0,65% 2,60% 4,31% 5,46% comes even close to this. Second is OpenVPN with only
FTP 33,52% 27,53% 29,96% 9,34% 23,68% 59,94% 37,12%
SSH 0,00% 1,55% – 0,52% 1,72% 1,43% – 494 bytes. Apparently, an unusually high amount of data –
ICMP 2,73% 24,25% 10,55% 0,86% 27,10% 5,05% 6,29% even for P2P – is leaving the participating peers. A likely
IMAP 0,15% 0,05% 1,03% 0,05% 0,18% 0,37% 0,81% explanation is that many foreign users watch streaming
POP3 18,22% 12,95% 12,69% 2,04% 11,29% 5,65% 20,32%
content provided by QQLive peers in the monitored ISP’s
SMTP 30,68% 30,60% 29,05% 1,60% 31,93% 15,72% 13,61%
Usenet 3,74% 0,00% 5,45% 84,88% 0,00% 7,32% 15,15% network.
Other 0,14% 1,04% 0,33% 0,06% 1,51% 0,20% 1,23%
Average packet size per protocol and direction
S. Africa
Protocol Down- Upstream Average Protocol Down- Upstream Average
S. America
stream Packet Packet stream Packet Packet
N. Africa Packet Size Size Packet Size Size
Size (Bytes) (Bytes) Size (Bytes) (Bytes)
Germany (Bytes) (Bytes)
S. Europe All 789 281 556 Pando 931 359 688
13 © ipoque 2009
About ipoque
ipoque is the leading European provider of deep packet inspection (DPI)
solutions for Internet traffic management and analysis. Designed for
Internet service providers, enterprises and educational institutions,
ipoque's PRX Traffic Manager allows to effectively monitor, shape and
optimize network applications. These include the most critical and hard-
to-detect protocols used for peer-to-peer file sharing (P2P), instant mes-
saging (IM), Voice over IP (VoIP), tunneling and media streaming, but
also many legacy applications.
Contact
For further information, please visit www.ipoque.com.
ipoque GmbH
Mozartstr. 3
D-04107 Leipzig
Germany Copyright Notice