Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Nemotron/Minitron GGUF Conversion & Inference Support #8922

Merged
merged 10 commits into from
Aug 16, 2024
Merged

Add Nemotron/Minitron GGUF Conversion & Inference Support #8922

merged 10 commits into from
Aug 16, 2024
+271 −11

Commits on Aug 13, 2024

  1. Add nemotron GGUF conversion & inference support

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    aa2f4a7 View commit details
    Browse the repository at this point in the history

  2. Fix formatting issues

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    45e9d16 View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary write_tensors()

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    147cdf6 View commit details
    Browse the repository at this point in the history

  4. Update convert_hf_to_gguf.py 

    Co-authored-by: compilade <[email protected]>
    @suhara @compilade
    suhara and compilade committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    b841554 View commit details
    Browse the repository at this point in the history

  5. Update src/llama.cpp 

    Co-authored-by: compilade <[email protected]>
    @suhara @compilade
    suhara and compilade committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    092382f View commit details
    Browse the repository at this point in the history

  6. Address comments by @compilade

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    6f369f3 View commit details
    Browse the repository at this point in the history

  7. Replace ggml_mul_mat()->llm_build_lora_mm()

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    ae86b5e View commit details
    Browse the repository at this point in the history

  8. Remove mutable variable

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    bd76198 View commit details
    Browse the repository at this point in the history

  9. Use for bias tensors

    @suhara
    suhara committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    e4bb91b View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Cover corner case for role_scaling not in config.json

    @suhara
    suhara committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    0645adc View commit details
    Browse the repository at this point in the history