Bump bitsandbytes from 0.42.0 to 0.43.1

[dependabot]

Bumps bitsandbytes from 0.42.0 to 0.43.1.

Release notes

Sourced from bitsandbytes's releases.

0.43.0: FSDP support, Official documentation, Cross-compilation on Linux and CI, Windows support

Improvements and New Features:

• QLoRA + FSDP official support is now live! TimDettmers/bitsandbytes#970 by @​warner-benjamin and team - with FSDP you can train very large models (70b scale) on multiple 24GB consumer-type GPUs. See https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html for more details.
• Introduced improvements to the CI process for enhanced performance and efficiency during builds, specifically enabling more effective cross-compilation on Linux platforms. This was accomplished by deprecating Make and migrating to Cmake, as well as implementing new corresponding workflows. Huge thanks go to @​wkpark, @​rickardp, @​matthewdouglas and @​younesbelkada; #1055, #1050, #1111.
• Windows should be officially supported in bitsandbytes with pip install bitsandbytes
• Updated installation instructions to provide more comprehensive guidance for users. This includes clearer explanations and additional tips for various setup scenarios, making the library more accessible to a broader audience (@​rickardp, #1047).
• Enhanced the library's compatibility and setup process, including fixes for CPU-only installations and improvements in CUDA setup error messaging. This effort aims to streamline the installation process and improve user experience across different platforms and setups (@​wkpark, @​akx, #1038, #996, #1012).
• Setup a new documentation at https://huggingface.co/docs/bitsandbytes/main with extensive new sections and content to help users better understand and utilize the library. Especially notable are the new API docs. (big thanks to @​stevhliu and @​mishig25 from HuggingFace #1012). The API docs have been also addressed in TimDettmers/bitsandbytes#1075

Bug Fixes:

• Addressed a race condition in kEstimateQuantiles, enhancing the reliability of quantile estimation in concurrent environments (@​pnunna93, #1061).
• Fixed various minor issues, including typos in code comments and documentation, to improve code clarity and prevent potential confusion (@​nairbv, #1063).

Backwards Compatibility

• After upgrading from v0.42 to v0.43, when using 4bit quantization, models may generate slightly different outputs (approximately up to the 2nd decimal place) due to a fix in the code. For anyone interested in the details, see this comment.

Internal and Build System Enhancements:

• Implemented several enhancements to the internal and build systems, including adjustments to the CI workflows, portability improvements, and build artifact management. These changes contribute to a more robust and flexible development process, ensuring the library's ongoing quality and maintainability (@​rickardp, @​akx, @​wkpark, @​matthewdouglas; #949, #1053, #1045, #1037).

Contributors:

This release is made possible thanks to the many active contributors that submitted PRs and many others who contributed to discussions, reviews, and testing. Your efforts greatly enhance the library's quality and user experience. It's truly inspiring to work with such a dedicated and competent group of volunteers and professionals!

We give a special thanks to @​TimDettmers for managing to find a little bit of time for valuable consultations on critical topics, despite preparing for and touring the states applying for professor positions. We wish him the utmost success!

We also extend our gratitude to the broader community for your continued support, feedback, and engagement, which play a crucial role in driving the library's development forward.

Changelog

Sourced from bitsandbytes's changelog.

0.43.1

Improvements:

• Improved the serialization format for 8-bit weights; this change is fully backwards compatible. (#1164, thanks to @​younesbelkada for the contributions and @​akx for the review).
• Added CUDA 12.4 support to the Linux x86-64 build workflow, expanding the library's compatibility with the latest CUDA versions. (#1171, kudos to @​matthewdouglas for this addition).
• Docs enhancement: Improved the instructions for installing the library from source. (#1149, special thanks to @​stevhliu for the enhancements).

Bug Fixes

• Fix 4bit quantization with blocksize = 4096, where an illegal memory access was encountered. (#1160, thanks @​matthewdouglas for fixing and @​YLGH for reporting)

Internal Improvements:

• Tests: improve memory usage (#1147, thanks @​matthewdouglas)
• Add CUDA 12.4 to docs/install helper (#1136, thanks @​matthewdouglas)
• Minor type/doc fixes (#1128, thanks @​akx)
• Reformat Python code with Ruff (#1081, thanks @​akx)
• Rework of CUDA/native-library setup and diagnostics (#1041, thanks @​akx)

0.43.0

Improvements and New Features:

• QLoRA + FSDP official support is now live! TimDettmers/bitsandbytes#970 by @​warner-benjamin and team - with FSDP you can train very large models (70b scale) on multiple 24GB consumer-type GPUs. See https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html for more details.
• Introduced improvements to the CI process for enhanced performance and efficiency during builds, specifically enabling more effective cross-compilation on Linux platforms. This was accomplished by deprecating Make and migrating to Cmake, as well as implementing new corresponding workflows. Huge thanks go to @​wkpark, @​rickardp, @​matthewdouglas and @​younesbelkada; #1055, #1050, #1111.
• Windows should be officially supported in bitsandbytes if you install the library from source. See: https://huggingface.co/docs/bitsandbytes/main/en/index for more details
• Updated installation instructions to provide more comprehensive guidance for users. This includes clearer explanations and additional tips for various setup scenarios, making the library more accessible to a broader audience (@​rickardp, #1047).
• Enhanced the library's compatibility and setup process, including fixes for CPU-only installations and improvements in CUDA setup error messaging. This effort aims to streamline the installation process and improve user experience across different platforms and setups (@​wkpark, @​akx, #1038, #996, #1012).
• Setup a new documentation at https://huggingface.co/docs/bitsandbytes/main with extensive new sections and content to help users better understand and utilize the library. Especially notable are the new API docs. (big thanks to @​stevhliu and @​mishig25 from HuggingFace #1012). The API docs have been also addressed in #1075.

Bug Fixes:

• Addressed a race condition in kEstimateQuantiles, enhancing the reliability of quantile estimation in concurrent environments (@​pnunna93, #1061).
• Fixed various minor issues, including typos in code comments and documentation, to improve code clarity and prevent potential confusion (@​Brian Vaughan, #1063).

Backwards Compatibility

• After upgrading from v0.42 to v0.43, when using 4bit quantization, models may generate slightly different outputs (approximately up to the 2nd decimal place) due to a fix in the code. For anyone interested in the details, see this comment.

Internal and Build System Enhancements:

• Implemented several enhancements to the internal and build systems, including adjustments to the CI workflows, portability improvements, and build artifact management. These changes contribute to a more robust and flexible development process, ensuring the library's ongoing quality and maintainability (@​rickardp, @​akx, @​wkpark, @​matthewdouglas; #949, #1053, #1045, #1037).

Contributors:

This release is made possible thanks to the many active contributors that submitted PRs and many others who contributed to discussions, reviews, and testing. Your efforts greatly enhance the library's quality and user experience. It's truly inspiring to work with such a dedicated and competent group of volunteers and professionals!

We give a special thanks to @​TimDettmers for managing to find a little bit of time for valuable consultations on critical topics, despite preparing for and touring the states applying for professor positions. We wish him the utmost success!

... (truncated)

Commits

• 4a6fb35 bump version to 0.43.1
• f92c536 CHANGELOG: add v0.43.1
• 0c33c0d ignore CHANGELOG reordering + formatting commit
• 4743ff0 CHANGELOG: to reverse chron order + mdformat
• 7449d71 [Core] Change 8-bit serialization weight format format (#1164)
• c54053d Bump scipy from 1.12.0 to 1.13.0 in the minor-patch group (#1170)
• 6be3d0f [docs] Install from source (#1149)
• 0c887b7 Merge pull request #1169 from TimDettmers/dependabot/pip/major-45b123642d
• af9a073 Merge pull request #1171 from matthewdouglas/build-cu124
• ebac862 Exclude Windows from CUDA 12.4.0 build for now
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)