Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow compressed-tensors quantized model to be trained #34520

Draft
wants to merge 15 commits into
base: main
Choose a base branch
from
Draft

Allow compressed-tensors quantized model to be trained #34520

wants to merge 15 commits into from
+33 −11

Commits on Oct 1, 2024

  1. populate quantization_config for kv-cache-scheme only configs

    @horheynm
    horheynm committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    dc19bc1 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. make compressed-tensors quantized models trainable

    @horheynm
    horheynm committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    b8a2d49 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into nm-train-quantized-models-from-compressed-te… 

    …nsors
    @horheynm
    horheynm authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    36b8899 View commit details
    Browse the repository at this point in the history

  3. populate versions on quant config

    @horheynm
    horheynm committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a8a757a View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. pass oneshot then finetune

    @horheynm
    horheynm committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    95a36a3 View commit details
    Browse the repository at this point in the history

  2. remove breakpoint

    @horheynm
    horheynm committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    4cf4fe2 View commit details
    Browse the repository at this point in the history

  3. SunMarc comments and fix to_dict logic

    @horheynm
    horheynm committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    dae8b3c View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Merge branch 'main' into nm-train-quantized-models-from-compressed-te… 

    …nsors
    @horheynm
    horheynm authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    07aac0f View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Merge branch 'main' into nm-train-quantized-models-from-compressed-te… 

    …nsors
    @horheynm
    horheynm authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    7bf07a8 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Merge branch 'main' into nm-train-quantized-models-from-compressed-te… 

    …nsors
    @horheynm
    horheynm authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    dfbf282 View commit details
    Browse the repository at this point in the history

  2. lint

    @horheynm
    horheynm committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    4387053 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'nm-train-quantized-models-from-compressed-tensors' of g… 

    …ithub.com:neuralmagic/upstream-transformers into nm-train-quantized-models-from-compressed-tensors
    @horheynm
    horheynm committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    abbc62b View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Merge branch 'main' into nm-train-quantized-models-from-compressed-te… 

    …nsors
    @horheynm
    horheynm authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    74c127f View commit details
    Browse the repository at this point in the history

  2. lint

    @horheynm
    horheynm committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    e4db207 View commit details
    Browse the repository at this point in the history

  3. test

    @horheynm
    horheynm committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    dca9c55 View commit details
    Browse the repository at this point in the history