develooper Front page | perl.perl5.changes | Postings from September 2019

[perl.git] branch tonyc/utf8-readline-old created.v5.31.4-33-g0d9326b7b3

Tony Cook
September 26, 2019 04:59
[perl.git] branch tonyc/utf8-readline-old created.v5.31.4-33-g0d9326b7b3
Message ID:
In perl.git, the branch tonyc/utf8-readline-old has been created


        at  0d9326b7b34279d88cb42b1adb7df7febdaa3cb5 (commit)

- Log -----------------------------------------------------------------
commit 0d9326b7b34279d88cb42b1adb7df7febdaa3cb5
Author: Tony Cook <>
Date:   Tue Jul 16 15:28:34 2019 +1000

    WIP start on adding warn on fail

commit 018e0fe97463e062b8188afb5d959a1fec254ec9
Author: Tony Cook <>
Date:   Tue Jan 15 15:38:17 2019 +1100

    eliminate unused code that was only left for reference

commit db56e839fe65baaa15ab9c56532a1e3868e68480
Author: Tony Cook <>
Date:   Tue Jan 15 10:38:55 2019 +1100

    fix error reporting from the buffer handler

commit 9777f78056871b5a3ecea3b2d0df4083da9efd96
Author: Tony Cook <>
Date:   Mon Jan 14 14:14:01 2019 +1100

    WIP fixing utf8_buf tests

commit 722acf2f382b5065ed2e78337acfca78041fe474
Author: Tony Cook <>
Date:   Thu Nov 29 09:56:00 2018 +1100


commit f01fc9ad90deeeed14ddd27ee882c70ac01c1f65
Author: Tony Cook <>
Date:   Thu Nov 22 22:04:53 2018 +1100


commit b489e202f169b2442286466b9d07edf37bce562c
Author: Tony Cook <>
Date:   Thu Nov 22 14:49:03 2018 +1100


commit 7622ce3dd16dc335e9126db3345eb818dd1f4734
Author: Tony Cook <>
Date:   Tue Nov 20 10:04:45 2018 +1100

    WIP, refactor a bit
    We don't want warnings or errors thrown inside the work function since we want
    to update the state of the perlio object before a possible exception.

commit 3541aaeb31da2364411b9e3b491900b6e7a75b09
Author: Tony Cook <>
Date:   Thu Aug 30 15:02:05 2018 +1000

    WIP, two tests failed

commit 82e520adfa8dfa8e8affa0f7d9455ec6e8a669b9
Author: Tony Cook <>
Date:   Mon Aug 27 10:47:15 2018 +1000

    work on optimizing non-mutating :utf8
    tests currently fail

commit 61c043937960bf9dc433b989d30ed0d1b6b4cb33
Author: Tony Cook <>
Date:   Mon Aug 20 15:11:25 2018 +1000

    more tests, more options

commit 450769ed6ea5145467f60b306819df14afb64dca
Author: Tony Cook <>
Date:   Wed Aug 15 13:26:55 2018 +1000

    fails tests atm

commit 656dca6f29fbc0705fde619187db5d2f1b467e26
Author: Tony Cook <>
Date:   Wed Aug 15 10:46:23 2018 +1000

    clean up code, add a few more tests

commit 5469f2b071f4ec025a946b18f6c02d40f59c6877
Author: Tony Cook <>
Date:   Mon Aug 13 15:02:46 2018 +1000

    bump $XS::APItest::VERSION

commit 7d9d932c2dd04c3bd9b792b160d672255c4d6633
Author: Tony Cook <>
Date:   Thu May 24 14:33:35 2018 +1000

    test for and fix seek() handling of any partial buffers

commit 08c12215c7b85b623dae03a3e72b2e4ea6fca31f
Author: Tony Cook <>
Date:   Thu May 24 11:22:58 2018 +1000

    various clean up, commit the tests

commit 72d9ac22187974293b8b3f93c5bfd16fafedd199
Author: Tony Cook <>
Date:   Mon May 21 15:35:09 2018 +1000

    fix a buffer offset issue in readdelim, fix porting issues
    added a bunch of tests, fixed the logic for partial handling to prevent
    duplicated warnings

commit 5622fc3fdefeeb3c2411341927db21e56a2be67f
Author: Tony Cook <>
Date:   Thu May 10 13:40:31 2018 +1000

    this code is WIP
    It's broken, don't expect it to work.
    Tests fail and new tests need to be written.
    Defaults and behaviour will change.
    I expect at least the following issues:
    - seeking to a tell position is broken (and to a certain extent
      may remain broken)[1]
    - a warning may be emitted more than once for the same error
    - the same message might be emitted more than once in the same croak
      for a single error
    - the readdelim code might infinite loop
    - if no tranformation is needed (ie. badly encoded isn't permitted at all,
      and we fail or craok for any other thing we treat as an error), then
      we could avoid the accumulation buffer (future optimization?)
    - the code might not follow the PerlIO API properly (which doesn't
      appear to be defined in detail)
    - this code might make you double-facepalm
    but I might be wrong.
    [1] since errors are transformed into the replacement character we can't
    use the position in the buffer to adjust the seek position, *but* that
    might end up being our best guess.  The other issue with the accumulation
    buffer should be fixable.

commit 5e02b5d1e4986775d38f069fc9c914da874da70e
Author: Tony Cook <>
Date:   Tue May 1 11:05:29 2018 +1000


commit 6889817955204dc3fec5eaaa6b13a4223beb69fa
Author: Tony Cook <>
Date:   Thu Apr 19 10:15:51 2018 +1000

    version bumps: need to be integrated back to their base commits

commit 9f913539b615e9c2603615449ab76443f47c4bbd
Author: Karl Williamson <>
Date:   Sat Dec 30 11:46:03 2017 -0700


commit 6e8d9c98fb69ce7ee6b2b3435892d25e629ebf37
Author: Leon Timmermans <>
Date:   Wed Dec 14 00:17:01 2016 +0100

    Make :via and :scalar use readdelim

commit 410566acd4d3a9b8e7b8b8cd957072c7ca0763d7
Author: Leon Timmermans <>
Date:   Mon Apr 9 21:49:11 2012 +0200

    Made :utf8 an actual layer
    It will check the input for validity, by default strict validity though less strict forms are provided. This also means PerlIO::get_layers doesn't return a "utf8" pseudo-layer anymore, which can break some code making that assumption.

commit fa20bd51d3f40995eeeb830a5694fc9bf9cf6d2f
Author: Leon Timmermans <>
Date:   Mon Nov 14 12:15:18 2016 +0100

    Make :encoding use the new readdelim method

commit c4db92cfefb3c7c465b2747a088af443bbfca565
Author: Leon Timmermans <>
Date:   Mon Nov 14 12:04:51 2016 +0100

    Add fast readdelim to main buffering layers

commit 26c3a4bf98f1b68a0459c59078faf05bd3ef5e00
Author: Leon Timmermans <>
Date:   Sun Dec 11 15:44:52 2016 +0100

    Implement new style readline and the slow fallback


Perl5 Master Repository Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at | Group listing | About