Release Python GIL when possible

[grantjenks]

I'm looking to search several million source files using the tree-sitter query interface. I'd love to use a thread pool in Python for this. Would it be possible to make a thread-safe Query.captures method that released the GIL?

I tried doing it in https://github.com/grantjenks/py-tree-sitter-languages but couldn't figure it out this evening (not sure it's possible with the current interface).

[ObserverOfTime]

PR welcome.

[ansipunk]

This might be slightly easier to implement with recent changes to GIL in 3.12:
https://docs.python.org/3.12/whatsnew/3.12.html#pep-684-a-per-interpreter-gil

[ObserverOfTime]

Another thing to consider is the free-threaded build in Python 3.13.

[ObserverOfTime]

I think we can't actually do this since the order of the results matters, right? @amaanq

[amaanq]

if we allocate a separate cursor per call to matches or captures, it'd be doable

[ObserverOfTime]

Nevermind, I misunderstood the issue.