./textproc/tree-sitter, Incremental parsing system for programming tools

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 0.25.6, Package name: tree-sitter-0.25.6, Maintainer: pkgsrc-users

Tree-sitter is a parser generator tool and an incremental parsing
library. It can build a concrete syntax tree for a source file and
efficiently update the syntax tree as the source file is edited.


Master sites:

Filesize: 836.982 KB

Version history: (Expand)


CVS history: (Expand)


   2025-06-06 23:27:01 by Thomas Klausner | Files touched by this commit (2) | Package updated
Log message:
tree-sitter: update to 0.25.6.

0.25.6

    Ignore lockfiles in grammar repos #4474
    Revert "feat: add build sha to parser.c header comment" by \ 
@tree-sitter-ci-bot in #4477
    Fix pkgconfig and use of GNUInstallDirs by @tree-sitter-ci-bot in #4480
    Fully fix field underflow in go_to_previous_sibling by @tree-sitter-ci-bot \ 
in #4485
    fix(generate): re-enable default url features by @tree-sitter-ci-bot in #4486

0.25.5

    illumos has endian.h by @tree-sitter-ci-bot in #4451
    fix: wasi has endian.h by @tree-sitter-ci-bot in #4464
    Fix crash w/ goto_previous_sibling when parent node has leading extra child \ 
by @tree-sitter-ci-bot in #4473
   2025-05-18 12:32:01 by Thomas Klausner | Files touched by this commit (2) | Package updated
Log message:
tree-sitter: update to 0.25.4.

What's Changed

    fix(lib): remove duplicate TSLanguageMetadata typedef by @tree-sitter-ci-bot \ 
in #4270
    fix(rust): adapt to new nightly lint by @tree-sitter-ci-bot in #4269
    build(deps): bump ring from 0.17.8 to 0.17.13 by @tree-sitter-ci-bot in #4281
    fix(cli): properly escape invisible characters in parse error output by \ 
@tree-sitter-ci-bot in #4279
    fix(xtask): error if new version supplied to xtask is less than or equal to \ 
current version by @tree-sitter-ci-bot in #4290
    fix(make): make install shouldn’t fail when a parser bundles no queries by \ 
@tree-sitter-ci-bot in #4291
    fix(rust): address new clippy lint for pointer comparisons by \ 
@tree-sitter-ci-bot in #4310
    fix(rust): use core crates for no_std by @clason in #4311
    fix(rust): address new nightly lint for pointer comparisons by \ 
@tree-sitter-ci-bot in #4314
    add generate crate to workspace & adjust to new clippy lints by \ 
@tree-sitter-ci-bot in #4197
    fix(highlight): account for multiple rows in highlight testing assertions by \ 
@tree-sitter-ci-bot in #4335
    Add @generated to parser.c header by @tree-sitter-ci-bot in #4344
    Fix WASI build by not calling a non-existent function. by \ 
@tree-sitter-ci-bot in #4346
    fix(rust): clarify error message for non-token reserved words by \ 
@tree-sitter-ci-bot in #4347
    Make highlighting more deterministic when themes are ambiguous by \ 
@tree-sitter-ci-bot in #4350
    fix(lib): reset parser options after use by @tree-sitter-ci-bot in #4361
    fix(web): correct childWithDescendant() functionality by @tree-sitter-ci-bot \ 
in #4369
    fix(ci): increase timeouts for flaky tests by @tree-sitter-ci-bot in #4374
    export wasm files to better support bundling use cases by \ 
@tree-sitter-ci-bot in #4378
    Tidy up the docs in auto-generated Rust bindings by @tree-sitter-ci-bot in #4377
    binding_web: replace dynamic require with import by @tree-sitter-ci-bot in #4380
    Refine the documentation and command line help for "parse --edits" \ 
by @tree-sitter-ci-bot in #4379
    perf(highlight): use BTreeMap over IndexMap for highlight configs by \ 
@tree-sitter-ci-bot in #4382
    fix(parse): mark logging closure as move by @tree-sitter-ci-bot in #4410
    fix(lib): do not access the alias sequence for the end subtree in \ 
ts_subtree_summarize_children by @tree-sitter-ci-bot in #4418
    fix(generate): mark url as a Windows-only dependency by @tree-sitter-ci-bot \ 
in #4415
    fix(rust): address some new nightly clippy lints by @tree-sitter-ci-bot in #4425
    fix(query): correct last_child_step_index in cases where a new step wasn't \ 
created. by @tree-sitter-ci-bot in #4428
    fix(lib): return early for empty predicate step slice by @tree-sitter-ci-bot \ 
in #4441
    0.25.4 by @WillLillis in #4442
   2025-03-10 16:49:36 by Thomas Klausner | Files touched by this commit (2) | Package updated
Log message:
tree-sitter: update to 0.25.3.

Fixed an infinite loop that could happen in some grammars during
error recovery if the end of the file was reached.

Fixed a parser-generation error where internal character set
constants were given external linkage, which could cause linking
errors on some platforms if multiple Tree-sitter parsers were
linked into the same application.
   2025-02-18 09:45:39 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
tree-sitter: updated to 0.25.2

0.25.2

Bug Fixes

Fixed a crash that could occur when loading WASM-compiled languages that were \ 
generated with an earlier version of the Tree-sitter CLI
Fixed incorrect tokenization when using WASM-compiled languages, if the \ 
language's external scanner did not assign to result_symbol
Fixed an infinite loop that could occur if external scanners returned empty \ 
extra tokens

Build

Decreased the rustc version required to build the tree-sitter-languages and \ 
tree-sitter crates
   2025-02-05 10:38:30 by Jonathan Perkin | Files touched by this commit (1)
Log message:
tree-sitter: Fix regression on SunOS.
   2025-02-02 18:51:10 by Thomas Klausner | Files touched by this commit (1)
Log message:
tree-sitter: fix library on NetBSD

It was using sys/endian.h but limiting the scope to POSIX,
so two symbols this uses were not available.
Add upstream bug report in comment.

Bump PKGREVISION.
   2025-02-02 16:54:45 by Thomas Klausner | Files touched by this commit (4) | Package updated
Log message:
tree-sitter: update to 0.25.1.

Fix pkg-config file path.

Features

    cli: Specify abi version via env var (#4173)

Bug Fixes

    bindings: Correct Zig bindings to expose a language function
    lib: Prevent finished_tree assertion failure (#4176)

Documentation

    Correct build steps for WASM files

Build System and CI

    Use ubuntu-22.04 for x64 builds (#4175)
    Bump version to 0.25.1

Other

    rust: Correct doc comments

0.25.0

Notices

This is a large release. As such, a few major changes and how to adapt to them \ 
are outlined below:

    web-tree-sitter was rewritten in TypeScript. With that, we also now publish \ 
the sourcemaps, and debug builds for the library. We also publish both CommonJS \ 
and ESM modules.
    The internal ABI was bumped to 15. The main benefits this brings is that the \ 
language name, version, supertype info, and reserved words are added to the \ 
parsers. To use ABI 15, you must have a tree-sitter.json file in your \ 
repository, since the version information for the parser is pulled from this \ 
file.
    Parsing and Querying should be cancelled using the "progress \ 
callback", rather than setting a timeout or a cancellation flag, which are \ 
now deprecated. To do so, use the "parse/query with options" function \ 
in the bindings you choose to use, in the next release the old way of timing out \ 
parsing will be removed, which allows us to get rid of our dependency on the \ 
time.h headers in the core library.
    MISSING nodes can now be queried, and queries involving supertypes are \ 
properly validated now.
    The ts_node_child_containing_descendant function was removed; use \ 
ts_node_child_with_descendant instead (which has nearly the same behavior but \ 
can also return descendant.)
    TSInput now includes a (mandatory) new field DecodeFunction, which allows \ 
passing a custom decode function. To use the builtin function, pass NULL.
    In the DSL, there is now a RustRegex function, which takes in a Rust regex \ 
as a string. All of the capabilities of Rust's regex engine are available here, \ 
which allows for some nice features that aren't possible with JavaScript \ 
regexes.
    We've migrated our documentation to mdBook, and greatly improved the docs.

Breaking

    Properly handle UTF-16 endianness encoding (#3740)
    Bump internal abi to 15 (#3803)
    Update playground with new web bindings (#4121)
    bindings: Update swift bindings (#4154)
    cli: Remove migration code for tree-sitter.json (#4107)
    generate: Use regex_syntax::Hir for expanding regexes (#3831)
    lib: Remove ts_node_child_containing_descendant (#4107)
    lib: Add the ability to specify a custom decode function (#3833)
    web: Rewrite the library in TypeScript (#4121)
    web: Use the WASM module in the bindings, and not the other way around (#4121)
    web: Rename pattern to patternIndex in QueryMatch (#4141)
    web: Deprecate Language.query in favor of new Query (#4141)

Features

    Drop legacy binding updates (#3734)
    Bump version to 0.25 (#3752)
    Allow setting the output directory for generated source files (#2614)
    Move scripts to xtasks (#3758)
    Add CST pretty-printer for parser output (#3762)
    Add version subcommand for versioning grammars (#3786)
    Add build sha to parser.c header comment (#3828)
    Implement a cache for get_column (#2503)
    Generate schema in tree-sitter.json (#3947)
    Support querying missing nodes (#3887)
    Add flag to output css classes instead of inline styles in HTML highlighter \ 
output (#3879)
    Add xtask to bump emscripten-version (#4015)
    Add 'reserved word' construct (#3896)
    Add Supertype API (#3938)
    Support passing in a Rust regex in the grammar dsl (#4076)
    Allow parser balancing to be cancellable (#4122)
    Remove lazy_static in favor of LazyLock (#4130)
    Add and apply eslint config (#4121)
    Begin autogenerating web-tree-sitter.d.ts (#4121)
    Publish both CJS and ESM files (#4121)
    Add a patternIndex field to QueryCapture (#4141)
    Improve PredicateStep types (#4141)
    Add the semantic version to TSLanguage, and expose an API for retrieving it \ 
(#4135)
    Add error information in the progress callback (#3987)
    bindings: Auto-detect scanners (#3809)
    bindings: Drop language name from node (#3184)
    bindings: Update some binding files (#3952)
    bindings: Drop python 3.9 support (#3799)
    bindings: Support free-threaded python build (#3799)
    bindings: Add opt-in zig bindings (#4144)
    bindings: Use cc 1.2 for Rust (#4156)
    cli: Verify assertions for every carat in tests, not just the first one (#3927)
    cli: Add nushell completions (#4000)
    cli: Don't validate email addresses in init command (#3999)
    cli: Show parse times in testing output (#3939)
    cli: Display parse and edit times separately for parse --time (#4016)
    cli: Make input handling agnostic (#4054)
    cli: Rework parse to use new input handler (#4054)
    cli: Rework query to use new input handler (#4054)
    cli: Rework highlight to use new input handler (#4054)
    cli: Rework tags to use new input handler (#4054)
    cli: Add json summary of parsing (#4048)
    cli: Allow test subcommand to include/exclude by corpus test file names (#4095)
    cli: Improve readability of parse debug output (#4118)
    generate: Add a comment with the tree-sitter version (#3825)
    generate: Add .exp and .lib files to gitignore template (#4079)
    generate: Explicitly disallow non-terminals in non-terminals (#4111)
    generate: Properly filter out unused rules (#4111)
    generate: Add an extra field for extra nodes in node-types.json (#4116)
    generate: Defer to ABI 14 if tree-sitter.json doesn't exist, rather than \ 
hard failing (#4156)
    highlight: Mark TSHighlighter fields as pub (#3990)
    init: Allow dashes in scopes (#4142)
    init: Add an optional funding field (#4142)
    init: Add a class-name field to grammars (#4142)
    init: Add a title field to grammars (#4142)
    lib: Wrap subtrees with changes in green circles (#3741)
    lib: Add the language name (#3184)
    lib: Add ts_parser_parse_with_options (#3843)
    lib: Add ts_query_cursor_exec_with_options (#3843)
    lib: Use const for TSCharacterRanges (#4027)
    lib: Implement Send + Sync for WasmStore (#4130)
    loader: Add language_for_configuration (#3816)
    loader: Add error message when a tree-sitter.json file is invalid (#3897)
    loader: Support multi-barreled file extensions (#3880)...
   2025-01-29 14:42:31 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
tree-sitter: updated to 0.24.7

0.24.7

Bug Fixes

lib: Use inclusive range check for non-empty nodes in next sibling computation