Re: word-at-a-time searching for UTF-8 invariants

On 11/16/2017 08:03 PM, Karl Williamson wrote:
> I have pushed a branch for review at
>
> https://perl5.git.perl.org/perl.git/shortlog/refs/heads/smoke-me/khw-invariant
>
>
> which changes is_utf8_invariant_string_loc() (and hence
> is_utf8_invariant_string(), which is defined as a special case of the
> former) to use word-at-a-time (instead of per-byte) parsing through
> the input string.
>
> This is commonly used functionality for parsing strings to decide if
> they are UTF-8 and need to have the UTF-8 flag on.
>
> [...]
>
>
> This means, for example, that the COND measurement is 800% faster.

Impressive!

What kind of user code would enjoy this speed up?

• word-at-a-time searching for UTF-8 invariants by Karl Williamson
• Re: word-at-a-time searching for UTF-8 invariants by Karl Williamson
• Re: word-at-a-time searching for UTF-8 invariants by Sawyer X
• Re: word-at-a-time searching for UTF-8 invariants by Karl Williamson