Re: word-at-a-time searching for UTF-8 invariants

On 11/19/2017 02:59 AM, Sawyer X wrote:
> 
> 
> On 11/16/2017 08:03 PM, Karl Williamson wrote:
>> I have pushed a branch for review at
>>
>> https://perl5.git.perl.org/perl.git/shortlog/refs/heads/smoke-me/khw-invariant
>>
>>
>> which changes is_utf8_invariant_string_loc() (and hence
>> is_utf8_invariant_string(), which is defined as a special case of the
>> former) to use word-at-a-time (instead of per-byte) parsing through
>> the input string.
>>
>> This is commonly used functionality for parsing strings to decide if
>> they are UTF-8 and need to have the UTF-8 flag on.
>>
>> [...]
>>
>>
>> This means, for example, that the COND measurement is 800% faster.
> 
> Impressive!
> 
> What kind of user code would enjoy this speed up?
> 

This would speed up  things like parsing text for needing to  set the 
UTF-8 flag for a PV in a SV, and reading input text

• word-at-a-time searching for UTF-8 invariants by Karl Williamson
• Re: word-at-a-time searching for UTF-8 invariants by Karl Williamson
• Re: word-at-a-time searching for UTF-8 invariants by Sawyer X
• Re: word-at-a-time searching for UTF-8 invariants by Karl Williamson