Skip to content

Add new-features section #1408

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
May 2, 2025
Merged

Add new-features section #1408

merged 4 commits into from
May 2, 2025

Conversation

rahul-tuli
Copy link
Collaborator

@rahul-tuli rahul-tuli commented May 2, 2025

This PR updates the main README.md to introduce a "New Features" section, improving visibility for recent major additions to LLM Compressor.

This section highlights:

Signed-off-by: Rahul Tuli <[email protected]>
Copy link

github-actions bot commented May 2, 2025

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

@rahul-tuli rahul-tuli self-assigned this May 2, 2025
@rahul-tuli rahul-tuli marked this pull request as ready for review May 2, 2025 13:56
Signed-off-by: Rahul Tuli <[email protected]>
Copy link
Collaborator

@kylesayrs kylesayrs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would formalize the tone a little bit here.

Axolotl only supports one modifier atm (iirc),

I would also avoid using words like "our", since this is an open source community project.

- Meta utilized LLM Compressor to create the
+ See the FP8-quantized Llama-4-Maverick-17B-128E model created using LLM Compressor by the Meta AI team

@rahul-tuli
Copy link
Collaborator Author

I would formalize the tone a little bit here.

Axolotl only supports one modifier atm (iirc),

I would also avoid using words like "our", since this is an open source community project.

- Meta utilized LLM Compressor to create the
+ See the FP8-quantized Llama-4-Maverick-17B-128E model created using LLM Compressor by the Meta AI team
  • I think the sentence reads okay;
  • I removed our and linked out to compressed-tensors.
  • w.r.t > Axolotl only supports one modifier atm (iirc),
    Which is all we need for Sparse Finetuning 👀

@rahul-tuli rahul-tuli added the ready When a PR is ready for review label May 2, 2025
@rahul-tuli rahul-tuli enabled auto-merge (squash) May 2, 2025 17:16
@rahul-tuli rahul-tuli merged commit 7bc1881 into main May 2, 2025
10 checks passed
@rahul-tuli rahul-tuli deleted the add-new-features-section branch May 2, 2025 17:45
kylesayrs pushed a commit that referenced this pull request May 4, 2025
This PR updates the main README.md to introduce a "New Features"
section, improving visibility for recent major additions to LLM
Compressor.

This section highlights:

- Axolotl Sparse Finetuning Integration
(https://docs.axolotl.ai/docs/custom_integrations.html#llmcompressor)
- AutoAWQ Integration for low-bit weight quantization (#1177)
- Day 0 Llama 4 support and its use by Meta
This helps users quickly understand the latest capabilities of the
library.

---------

Signed-off-by: Rahul Tuli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready When a PR is ready for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants