Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Option to split during conversion #6942

Draft
wants to merge 10 commits into
base: master
Choose a base branch
from
Draft

Option to split during conversion #6942

wants to merge 10 commits into from
+592 −12

Commits on Apr 27, 2024

  1. support splits in convert.py

    @christianazinn
    christianazinn committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    874c341 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. Support split by size and dry run to write estimated shards/filesizes

    @christianazinn
    christianazinn committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    72cbd4e View commit details
    Browse the repository at this point in the history

  2. Move split functionality to new GGUFManager class

    @christianazinn
    christianazinn committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    702a744 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. fix improper function signature

    @christianazinn
    christianazinn committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    c33bdf3 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. tentative push of convert-hf-to-gguf support

    @christianazinn
    christianazinn committed May 5, 2024
    Configuration menu
    Copy the full SHA
    b7c6120 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Merge branch 'master' into convert-split

    @mofosyne
    mofosyne committed May 9, 2024
    Configuration menu
    Copy the full SHA
    14b3291 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. resolve merge + SplitArguments for easier parsing

    @christianazinn
    christianazinn committed May 10, 2024
    Configuration menu
    Copy the full SHA
    87a98a5 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge remote-tracking branch 'origin' into convert-split

    @christianazinn
    christianazinn committed May 23, 2024
    Configuration menu
    Copy the full SHA
    2dd7841 View commit details
    Browse the repository at this point in the history

  2. Fix eager tensor memory leak and remove convert.py changes 

    Removed a memory leak caused by unexpected reference retention to eager tensors.

Also removed GGUFManager functionality in convert.py in favor of specializing for convert-hf-to-gguf.py.
    @christianazinn
    christianazinn committed May 23, 2024
    Configuration menu
    Copy the full SHA
    3ff27ef View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. refactor SplitStrategy to be a deque 

    Instead of having SplitStrategy have a `data` field that is a deque, just have SplitStrategy be a subclass of deque itself.
    @christianazinn
    christianazinn committed May 24, 2024
    Configuration menu
    Copy the full SHA
    6b5c375 View commit details
    Browse the repository at this point in the history