develooper Front page | perl.perl5.porters | Postings from December 2016

Notice of some changes in XS and core UTF-8 handling

From:
Karl Williamson
Date:
December 24, 2016 18:35
Subject:
Notice of some changes in XS and core UTF-8 handling
Message ID:
bf3d3041-3f83-f36a-5cd4-9919e313cb0a@khwilliamson.com
New macros have been created in blead for doing character classification 
and character case changing of UTF-8 encoded strings.  For example, 
isALPHA_utf8_safe(), toLOWER_utf8_safe().  These take an extra parameter 
so that the macro can be sure to not read past the end of the string 
when the UTF-8 is malformed.  The existing macros are deprecated, and 
will raise a warning to that effect on the first use in each call point 
of a program.  Details are in perlapi.

Also, handling of some UTF-8 malformations has been changed in the 
bottom level decode routines.  These are unlikely to affect anyone; 
details are in perldelta, and perlapi.



nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About