Change8

b8243

📦 llama-cppView on GitHub →
3 features🐛 1 fixes🔧 1 symbols

Summary

This release focuses on improving robustness in handling incomplete input streams by refining the PEG parser context and introducing a 'needs_more_input' signal for continuations. Numerous platform-specific binaries are also provided.

Migration Steps

  1. If relying on internal state related to partial parsing, note that the 'partial' flag in the PEG parse context has been removed and replaced by the 'lenient' flag.

✨ New Features

  • Improved graceful handling of incomplete output during processing.
  • Added logic to emit 'needs_more_input' when the end of input is reached prematurely during continuation.
  • Refactored PEG parse context to use a 'lenient' flag instead of a 'partial' flag.

🐛 Bug Fixes

  • Fixed handling of incomplete UTF-8 sequences at the end of input in the PEG parser.

Affected Symbols