Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python312Packages.tree-sitter: enable tests #377525

Merged
merged 1 commit into from
Feb 12, 2025

Conversation

gepbird
Copy link
Contributor

@gepbird gepbird commented Jan 28, 2025

Fixes #372375

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@gepbird

This comment was marked as outdated.

@nix-owners nix-owners bot requested a review from GaetanLepage January 28, 2025 12:03
@gepbird

This comment was marked as outdated.

@gepbird

This comment was marked as outdated.

Copy link
Contributor

@GaetanLepage GaetanLepage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix !

@wegank wegank added 12.approvals: 1 This PR was reviewed and approved by one reputable person 12.approved-by: package-maintainer This PR was reviewed and approved by a maintainer listed in the package labels Feb 1, 2025
@gepbird gepbird marked this pull request as draft February 7, 2025 10:26
@gepbird gepbird force-pushed the py-tree-sitter-fix-build branch 3 times, most recently from 00d61f5 to 36fc8b9 Compare February 7, 2025 10:50
@gepbird gepbird changed the title python312Packages.tree-sitter: fix build on aarch64-linux, 0.23.2 -> 0.24.0 python312Packages.tree-sitter: enable tests; {private-gpt,harlequin}: fix build Feb 7, 2025
@gepbird
Copy link
Contributor Author

gepbird commented Feb 7, 2025

@GaetanLepage Fixed merge conflicts. We tried to debug this issue with upstream who provided a patch. In the meantime tests were disabled for python tree-sitter to fix the same issue, I think the patch can be a little safer, just in case dependant packages get a random segfault, but so far this didn't happen.

@K900 I see you were confused with how python tree-sitter only fails on aarch64 in 3f33d0eedccca, in short this is what we know so far about this bug:

  • it only happens on aarch64-linux with gcc14Stdenv (gcc13 on all platforms or gcc14 on darwin and x86_64-linux has no issues)
  • it could be a gcc bug: disabling/lowering some -O3 features related to inlining fixes the issue
  • I couldn't repro it without nix (very possible that it's my lack of experience with c and cpython), so maybe its an issue with the nix stdenv, gcc or python?
  • it can be a bug in the core tree-sitter repo that is also used for many other packages in nix

Upstream issue: tree-sitter/py-tree-sitter#330 (comment)

@gepbird gepbird marked this pull request as ready for review February 7, 2025 11:09
@gepbird
Copy link
Contributor Author

gepbird commented Feb 7, 2025

python tree-sitter builds, but some dependencies of private-gpt are failing

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 377525


x86_64-linux

❌ 4 packages failed to build:
  • private-gpt
  • private-gpt.dist
  • python312Packages.private-gpt
  • python312Packages.private-gpt.dist

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 377525


aarch64-linux

⏩ 20 packages marked as broken and skipped:
  • private-gpt
  • private-gpt.dist
  • python312Packages.grep-ast
  • python312Packages.grep-ast.dist
  • python312Packages.llama-index
  • python312Packages.llama-index-cli
  • python312Packages.llama-index-cli.dist
  • python312Packages.llama-index-vector-stores-chroma
  • python312Packages.llama-index-vector-stores-chroma.dist
  • python312Packages.llama-index.dist
  • python312Packages.private-gpt
  • python312Packages.private-gpt.dist
  • python312Packages.tree-sitter-languages
  • python312Packages.tree-sitter-languages.dist
  • python313Packages.grep-ast
  • python313Packages.grep-ast.dist
  • python313Packages.tree-sitter-languages
  • python313Packages.tree-sitter-languages.dist
  • zeekscript
  • zeekscript.dist
❌ 119 packages failed to build:
  • browsr
  • browsr.dist
  • frogmouth
  • frogmouth.dist
  • harlequin
  • harlequin.dist
  • isd
  • isd.dist
  • isponsorblocktv
  • isponsorblocktv.dist
  • memray
  • memray.dist
  • mutmut
  • mutmut.dist
  • oterm
  • oterm.dist
  • python312Packages.llama-index-agent-openai
  • python312Packages.llama-index-agent-openai.dist
  • python312Packages.llama-index-core
  • python312Packages.llama-index-core.dist
  • python312Packages.llama-index-embeddings-gemini
  • python312Packages.llama-index-embeddings-gemini.dist
  • python312Packages.llama-index-embeddings-google
  • python312Packages.llama-index-embeddings-google.dist
  • python312Packages.llama-index-embeddings-huggingface
  • python312Packages.llama-index-embeddings-huggingface.dist
  • python312Packages.llama-index-embeddings-ollama
  • python312Packages.llama-index-embeddings-ollama.dist
  • python312Packages.llama-index-embeddings-openai
  • python312Packages.llama-index-embeddings-openai.dist
  • python312Packages.llama-index-graph-stores-nebula
  • python312Packages.llama-index-graph-stores-nebula.dist
  • python312Packages.llama-index-graph-stores-neo4j
  • python312Packages.llama-index-graph-stores-neo4j.dist
  • python312Packages.llama-index-graph-stores-neptune
  • python312Packages.llama-index-graph-stores-neptune.dist
  • python312Packages.llama-index-indices-managed-llama-cloud
  • python312Packages.llama-index-indices-managed-llama-cloud.dist
  • python312Packages.llama-index-legacy
  • python312Packages.llama-index-legacy.dist
  • python312Packages.llama-index-llms-ollama
  • python312Packages.llama-index-llms-ollama.dist
  • python312Packages.llama-index-llms-openai
  • python312Packages.llama-index-llms-openai-like
  • python312Packages.llama-index-llms-openai-like.dist
  • python312Packages.llama-index-llms-openai.dist
  • python312Packages.llama-index-multi-modal-llms-openai
  • python312Packages.llama-index-multi-modal-llms-openai.dist
  • python312Packages.llama-index-program-openai
  • python312Packages.llama-index-program-openai.dist
  • python312Packages.llama-index-question-gen-openai
  • python312Packages.llama-index-question-gen-openai.dist
  • python312Packages.llama-index-readers-database
  • python312Packages.llama-index-readers-database.dist
  • python312Packages.llama-index-readers-file
  • python312Packages.llama-index-readers-file.dist
  • python312Packages.llama-index-readers-json
  • python312Packages.llama-index-readers-json.dist
  • python312Packages.llama-index-readers-llama-parse
  • python312Packages.llama-index-readers-llama-parse.dist
  • python312Packages.llama-index-readers-s3
  • python312Packages.llama-index-readers-s3.dist
  • python312Packages.llama-index-readers-twitter
  • python312Packages.llama-index-readers-twitter.dist
  • python312Packages.llama-index-readers-txtai
  • python312Packages.llama-index-readers-txtai.dist
  • python312Packages.llama-index-readers-weather
  • python312Packages.llama-index-readers-weather.dist
  • python312Packages.llama-index-vector-stores-google
  • python312Packages.llama-index-vector-stores-google.dist
  • python312Packages.llama-index-vector-stores-postgres
  • python312Packages.llama-index-vector-stores-postgres.dist
  • python312Packages.llama-index-vector-stores-qdrant
  • python312Packages.llama-index-vector-stores-qdrant.dist
  • python312Packages.llama-parse
  • python312Packages.llama-parse.dist
  • python312Packages.manifestoo
  • python312Packages.manifestoo.dist
  • python312Packages.pytest-textual-snapshot
  • python312Packages.pytest-textual-snapshot.dist
  • python312Packages.textual
  • python312Packages.textual-dev
  • python312Packages.textual-dev.dist
  • python312Packages.textual-fastdatatable
  • python312Packages.textual-fastdatatable.dist
  • python312Packages.textual-slider
  • python312Packages.textual-slider.dist
  • python312Packages.textual-textarea
  • python312Packages.textual-textarea.dist
  • python312Packages.textual-universal-directorytree
  • python312Packages.textual-universal-directorytree.dist
  • python312Packages.textual.dist
  • python313Packages.lsp-tree-sitter
  • python313Packages.lsp-tree-sitter.dist
  • python313Packages.manifestoo
  • python313Packages.manifestoo.dist
  • python313Packages.pytest-textual-snapshot
  • python313Packages.pytest-textual-snapshot.dist
  • python313Packages.textual
  • python313Packages.textual-dev
  • python313Packages.textual-dev.dist
  • python313Packages.textual-fastdatatable
  • python313Packages.textual-fastdatatable.dist
  • python313Packages.textual-slider
  • python313Packages.textual-slider.dist
  • python313Packages.textual-textarea
  • python313Packages.textual-textarea.dist
  • python313Packages.textual-universal-directorytree
  • python313Packages.textual-universal-directorytree.dist
  • python313Packages.textual.dist
  • rich-cli
  • rich-cli.dist
  • streamcontroller
  • tftui
  • tftui.dist
  • upiano
  • upiano.dist
  • wsrepl
  • wsrepl.dist
✅ 18 packages built:
  • autotools-language-server
  • autotools-language-server.dist
  • codecov-cli
  • codecov-cli.dist
  • dooit
  • dooit-extras
  • dooit-extras.dist
  • dooit.dist
  • python312Packages.lsp-tree-sitter
  • python312Packages.lsp-tree-sitter.dist
  • python312Packages.tree-sitter
  • python312Packages.tree-sitter.dist
  • python313Packages.tree-sitter
  • python313Packages.tree-sitter.dist
  • smassh
  • smassh.dist
  • toolong
  • toolong.dist

@gepbird gepbird force-pushed the py-tree-sitter-fix-build branch from 36fc8b9 to 06cbc04 Compare February 7, 2025 12:43
@gepbird gepbird changed the title python312Packages.tree-sitter: enable tests; {private-gpt,harlequin}: fix build python312Packages.tree-sitter: enable tests Feb 7, 2025
@wegank wegank removed the 12.approvals: 1 This PR was reviewed and approved by one reputable person label Feb 7, 2025
@gepbird gepbird force-pushed the py-tree-sitter-fix-build branch from 06cbc04 to c31e83e Compare February 12, 2025 14:30
@GaetanLepage
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 377525


aarch64-linux

⏩ 20 packages marked as broken and skipped:
  • private-gpt
  • private-gpt.dist
  • python312Packages.grep-ast
  • python312Packages.grep-ast.dist
  • python312Packages.llama-index
  • python312Packages.llama-index-cli
  • python312Packages.llama-index-cli.dist
  • python312Packages.llama-index-vector-stores-chroma
  • python312Packages.llama-index-vector-stores-chroma.dist
  • python312Packages.llama-index.dist
  • python312Packages.private-gpt
  • python312Packages.private-gpt.dist
  • python312Packages.tree-sitter-languages
  • python312Packages.tree-sitter-languages.dist
  • python313Packages.grep-ast
  • python313Packages.grep-ast.dist
  • python313Packages.tree-sitter-languages
  • python313Packages.tree-sitter-languages.dist
  • zeekscript
  • zeekscript.dist
❌ 72 packages failed to build:
  • browsr
  • browsr.dist
  • harlequin
  • harlequin.dist
  • isponsorblocktv
  • isponsorblocktv.dist
  • python312Packages.llama-index-agent-openai
  • python312Packages.llama-index-agent-openai.dist
  • python312Packages.llama-index-core
  • python312Packages.llama-index-core.dist
  • python312Packages.llama-index-embeddings-gemini
  • python312Packages.llama-index-embeddings-gemini.dist
  • python312Packages.llama-index-embeddings-google
  • python312Packages.llama-index-embeddings-google.dist
  • python312Packages.llama-index-embeddings-huggingface
  • python312Packages.llama-index-embeddings-huggingface.dist
  • python312Packages.llama-index-embeddings-ollama
  • python312Packages.llama-index-embeddings-ollama.dist
  • python312Packages.llama-index-embeddings-openai
  • python312Packages.llama-index-embeddings-openai.dist
  • python312Packages.llama-index-graph-stores-nebula
  • python312Packages.llama-index-graph-stores-nebula.dist
  • python312Packages.llama-index-graph-stores-neo4j
  • python312Packages.llama-index-graph-stores-neo4j.dist
  • python312Packages.llama-index-graph-stores-neptune
  • python312Packages.llama-index-graph-stores-neptune.dist
  • python312Packages.llama-index-indices-managed-llama-cloud
  • python312Packages.llama-index-indices-managed-llama-cloud.dist
  • python312Packages.llama-index-legacy
  • python312Packages.llama-index-legacy.dist
  • python312Packages.llama-index-llms-ollama
  • python312Packages.llama-index-llms-ollama.dist
  • python312Packages.llama-index-llms-openai
  • python312Packages.llama-index-llms-openai-like
  • python312Packages.llama-index-llms-openai-like.dist
  • python312Packages.llama-index-llms-openai.dist
  • python312Packages.llama-index-multi-modal-llms-openai
  • python312Packages.llama-index-multi-modal-llms-openai.dist
  • python312Packages.llama-index-program-openai
  • python312Packages.llama-index-program-openai.dist
  • python312Packages.llama-index-question-gen-openai
  • python312Packages.llama-index-question-gen-openai.dist
  • python312Packages.llama-index-readers-database
  • python312Packages.llama-index-readers-database.dist
  • python312Packages.llama-index-readers-file
  • python312Packages.llama-index-readers-file.dist
  • python312Packages.llama-index-readers-json
  • python312Packages.llama-index-readers-json.dist
  • python312Packages.llama-index-readers-llama-parse
  • python312Packages.llama-index-readers-llama-parse.dist
  • python312Packages.llama-index-readers-s3
  • python312Packages.llama-index-readers-s3.dist
  • python312Packages.llama-index-readers-twitter
  • python312Packages.llama-index-readers-twitter.dist
  • python312Packages.llama-index-readers-txtai
  • python312Packages.llama-index-readers-txtai.dist
  • python312Packages.llama-index-readers-weather
  • python312Packages.llama-index-readers-weather.dist
  • python312Packages.llama-index-vector-stores-google
  • python312Packages.llama-index-vector-stores-google.dist
  • python312Packages.llama-index-vector-stores-postgres
  • python312Packages.llama-index-vector-stores-postgres.dist
  • python312Packages.llama-index-vector-stores-qdrant
  • python312Packages.llama-index-vector-stores-qdrant.dist
  • python312Packages.llama-parse
  • python312Packages.llama-parse.dist
  • python312Packages.textual-dev
  • python312Packages.textual-dev.dist
  • python313Packages.lsp-tree-sitter
  • python313Packages.lsp-tree-sitter.dist
  • python313Packages.textual-dev
  • python313Packages.textual-dev.dist
✅ 65 packages built:
  • autotools-language-server
  • autotools-language-server.dist
  • codecov-cli
  • codecov-cli.dist
  • dooit
  • dooit-extras
  • dooit-extras.dist
  • dooit.dist
  • frogmouth
  • frogmouth.dist
  • isd
  • isd.dist
  • memray
  • memray.dist
  • mutmut
  • mutmut.dist
  • oterm
  • oterm.dist
  • python312Packages.lsp-tree-sitter
  • python312Packages.lsp-tree-sitter.dist
  • python312Packages.manifestoo
  • python312Packages.manifestoo.dist
  • python312Packages.pytest-textual-snapshot
  • python312Packages.pytest-textual-snapshot.dist
  • python312Packages.textual
  • python312Packages.textual-fastdatatable
  • python312Packages.textual-fastdatatable.dist
  • python312Packages.textual-slider
  • python312Packages.textual-slider.dist
  • python312Packages.textual-textarea
  • python312Packages.textual-textarea.dist
  • python312Packages.textual-universal-directorytree
  • python312Packages.textual-universal-directorytree.dist
  • python312Packages.textual.dist
  • python312Packages.tree-sitter
  • python312Packages.tree-sitter.dist
  • python313Packages.manifestoo
  • python313Packages.manifestoo.dist
  • python313Packages.pytest-textual-snapshot
  • python313Packages.pytest-textual-snapshot.dist
  • python313Packages.textual
  • python313Packages.textual-fastdatatable
  • python313Packages.textual-fastdatatable.dist
  • python313Packages.textual-slider
  • python313Packages.textual-slider.dist
  • python313Packages.textual-textarea
  • python313Packages.textual-textarea.dist
  • python313Packages.textual-universal-directorytree
  • python313Packages.textual-universal-directorytree.dist
  • python313Packages.textual.dist
  • python313Packages.tree-sitter
  • python313Packages.tree-sitter.dist
  • rich-cli
  • rich-cli.dist
  • smassh
  • smassh.dist
  • streamcontroller
  • tftui
  • tftui.dist
  • toolong
  • toolong.dist
  • upiano
  • upiano.dist
  • wsrepl
  • wsrepl.dist

Copy link
Contributor

@GaetanLepage GaetanLepage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Failures are not regressions.
Thank you for the PR :)

@GaetanLepage GaetanLepage merged commit da3c253 into NixOS:master Feb 12, 2025
26 of 27 checks passed
@gepbird gepbird deleted the py-tree-sitter-fix-build branch February 12, 2025 23:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Build failure: python312Packages.tree-sitter on aarch64-linux
3 participants