develooper Front page | perl.perl5.porters | Postings from January 2010

utf8 growth on the web.

Thread Previous | Thread Next
karl williamson
January 29, 2010 08:54
utf8 growth on the web.
Message ID:
Google just published this graph of the growth of utf8-encoded web 
pages.  I thought that since perl5 is the "duct tape of the internet", 
people here might be interested.

I don't know how they distinguish between ascii and utf8 web pages.  The 
encodings that web pages say they are in are often wrong, so Google has 
developed an algorithm to (quickly) figure out the correct value, and 
the graph is based on that.

If you don't want to look at the link, the bottom line is that it shows 
a nearly exponential growth rate of utf8, at the expense of every other 
encoding, but particularly ascii and latin1/15 (which had the most to 
lose anyway), with the combination of ascii+utf8 being about 2/3, and 
utf8 alone just under half of all web pages.

Thread Previous | Thread Next Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at | Group listing | About