{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":570384908,"defaultBranch":"main","name":"peft","ownerLogin":"huggingface","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-11-25T03:51:09.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/25720743?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1715943046.0","currentOid":""},"activityList":{"items":[{"before":"4e32679f37f52e85797faedfc146f80a47a3599a","after":"fb7f2796e5411ee86588447947d1fdd5b6395cad","ref":"refs/heads/main","pushedAt":"2024-05-17T16:59:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"pacman100","name":"Sourab Mangrulkar","path":"/pacman100","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13534540?s=80&v=4"},"commit":{"message":"Add add_weighted_adapter to IA3 adapters (#1701)\n\n* Add add_weighted_adapter to IA3 adapters\r\n\r\n* Refactor to simplify code\r\n\r\n* refactor test\r\n\r\n* Add IA3 merging docs\r\n\r\n* Update docs/source/developer_guides/model_merging.md\r\n\r\nCo-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>\r\n\r\n* Update docs/source/developer_guides/model_merging.md\r\n\r\nCo-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>\r\n\r\n* address PR feedback\r\n\r\n---------\r\n\r\nCo-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>","shortMessageHtmlLink":"Add add_weighted_adapter to IA3 adapters (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2273584021\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1701\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1701/hovercard\" href=\"https://github.com/huggingface/peft/pull/1701\">#1701</a>)"}},{"before":"3f7aacd6015451506ba3b85ba8582e8076b6cced","after":"4e32679f37f52e85797faedfc146f80a47a3599a","ref":"refs/heads/main","pushedAt":"2024-05-17T16:03:27.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"TST: torch compile tests (#1725)\n\nRight now, we don't have specific tests for torch.compile. Instead, we\r\nhave a \"hack\" that allows to run _all_ tests with torch.compile if we\r\nset the environment variable PEFT_DEBUG_WITH_TORCH_COMPILE=1.\r\n\r\nThis is not very practical because it takes a lot of time to run all\r\nthese tests with compilation enabled. Also, currently hundreds of tests\r\nare failing, which makes it impossible to understand more closely what\r\ndoes or does not work.\r\n\r\nThis PR removes the aforementioned \"hack\" and instead replaces it with a\r\nlist of explicit torch.compile tests. Currently, these tests cover\r\ntraining/inference with a bunch of different tuner types, as well as\r\nmore advanced features with LoRA (e.g. quantization, multiple adapters,\r\netc.).\r\n\r\nSome of these tests pass and some of them fail. This is documented now,\r\nso that users can quickly look up if their use case would be compatible\r\nwith torch.compile. This is very useful to have, because sometimes\r\ntorch.compile may appear to work but actually returns the wrong result.\r\nFor users, it's not immediately obvious when this happens.\r\n\r\nThe test suite is not exhaustive, there are many combinations of\r\nfeatures that could be added. However, it should be a good starting\r\npoint and can be extended later.\r\n\r\nThe test suite does _not_ cover whether torch.compile actually\r\naccelerates the code. This may not be the case even if it works\r\ncorrectly (e.g. because of graph breaks). Testing this would require\r\nbigger models and more data, which is prohibitively slow to test.\r\n\r\n---------\r\n\r\nCo-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>\r\nCo-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>","shortMessageHtmlLink":"TST: torch compile tests (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2290047734\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1725\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1725/hovercard\" href=\"https://github.com/huggingface/peft/pull/1725\">#1725</a>)"}},{"before":"e3eeabfad2ed813ef6fba2661bd5a73282871814","after":"3f7aacd6015451506ba3b85ba8582e8076b6cced","ref":"refs/heads/main","pushedAt":"2024-05-17T13:37:30.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Bump version to 0.11.2.dev0 (#1741)\n\nAfter patch release of 0.11.1.","shortMessageHtmlLink":"Bump version to 0.11.2.dev0 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2302695749\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1741\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1741/hovercard\" href=\"https://github.com/huggingface/peft/pull/1741\">#1741</a>)"}},{"before":null,"after":"207376de6282977844eae58e4a8afc6406d7751f","ref":"refs/heads/patch-release-0.11.1","pushedAt":"2024-05-17T10:50:15.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Release v0.11.1","shortMessageHtmlLink":"Release v0.11.1"}},{"before":"ae1ae20b768d8bafc1b7660f4b8153033e684c32","after":"e3eeabfad2ed813ef6fba2661bd5a73282871814","ref":"refs/heads/main","pushedAt":"2024-05-17T10:43:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FIX BOFT setting env vars breaks C++ compilation (#1739)\n\nResolves #1738","shortMessageHtmlLink":"FIX BOFT setting env vars breaks C++ compilation (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2302334249\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1739\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1739/hovercard\" href=\"https://github.com/huggingface/peft/pull/1739\">#1739</a>)"}},{"before":"2535036c240be57a656b86b72d96ce6da536e41b","after":"ae1ae20b768d8bafc1b7660f4b8153033e684c32","ref":"refs/heads/main","pushedAt":"2024-05-16T15:11:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Autocast adapter weights if fp16/bf16 (#1706)\n\nAs discussed internally, we want to automatically cast the weights of\r\nthe adapter to float32 when using float16. Float16 is not conducive to\r\nstable training and raises errors when used with AMP.\r\n\r\nPreviously, we had to recommend to users to manually cast the weights\r\nif they loaded the base model in float16, because PEFT would choose the\r\nsame dtype for the adapter as for the base weights. Forgetting this is a\r\ncommon source of errors, so we choose to automate this.\r\n\r\nIf this causes trouble, users can prevent the behavior by passing\r\nautocast_adapter_dtype=False to get_peft_model,\r\nPeftModel.from_pretrained, or PeftModel.load_adapter.\r\n\r\nThis PR should be reviewed carefully, as it has the potential to break\r\nexisting code if something important was missed. We also need to add a\r\nnote for the upcoming release text about this change in behavior.","shortMessageHtmlLink":"Autocast adapter weights if fp16/bf16 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2277439520\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1706\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1706/hovercard\" href=\"https://github.com/huggingface/peft/pull/1706\">#1706</a>)"}},{"before":"e003ae78506f316fb0e6a97e6132cb4c590a47ab","after":"2535036c240be57a656b86b72d96ce6da536e41b","ref":"refs/heads/main","pushedAt":"2024-05-16T14:27:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"ENH Save and load base model with revision (#1658)","shortMessageHtmlLink":"ENH Save and load base model with revision (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2246677494\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1658\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1658/hovercard\" href=\"https://github.com/huggingface/peft/pull/1658\">#1658</a>)"}},{"before":"0649947396a946a9333b731bea2e76551e85ad92","after":"e003ae78506f316fb0e6a97e6132cb4c590a47ab","ref":"refs/heads/main","pushedAt":"2024-05-16T10:34:29.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Bump version to 0.11.1.dev0 (#1736)","shortMessageHtmlLink":"Bump version to 0.11.1.dev0 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2299939600\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1736\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1736/hovercard\" href=\"https://github.com/huggingface/peft/pull/1736\">#1736</a>)"}},{"before":"b5acf5d6be27cc29e3261a9dab4ca6644e5b3f69","after":"0649947396a946a9333b731bea2e76551e85ad92","ref":"refs/heads/main","pushedAt":"2024-05-16T09:41:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Release: v0.11.0 (#1733)","shortMessageHtmlLink":"Release: v0.11.0 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2297384803\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1733\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1733/hovercard\" href=\"https://github.com/huggingface/peft/pull/1733\">#1733</a>)"}},{"before":"748f7968f3a31ec06a1c2b0328993319ad9a150a","after":"b5acf5d6be27cc29e3261a9dab4ca6644e5b3f69","ref":"refs/heads/main","pushedAt":"2024-05-15T09:35:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Add PiSSA as an initialization method of LoRA (#1626)\n\nImplements https://huggingface.co/papers/2404.02948.","shortMessageHtmlLink":"Add PiSSA as an initialization method of LoRA (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2229522445\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1626\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1626/hovercard\" href=\"https://github.com/huggingface/peft/pull/1626\">#1626</a>)"}},{"before":"47b3712898539569c02ec5b3ed4a6c36811331a1","after":"748f7968f3a31ec06a1c2b0328993319ad9a150a","ref":"refs/heads/main","pushedAt":"2024-05-14T15:10:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FIX Allow DoRA init on CPU when using BNB (#1724)\n\nResolves #1674\r\n\r\nFor some users, it is necessary to initialize the model on CPU, even\r\nwhen using BitsAndBytes, which requires a GPU eventually. Since DoRA\r\nrequires to dequantize the BNB weights at initialization, we need to\r\ntemporarily move the model corresponding weights to GPU. After\r\ndequantization, the weights are moved back to CPU.","shortMessageHtmlLink":"FIX Allow DoRA init on CPU when using BNB (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2289494437\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1724\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1724/hovercard\" href=\"https://github.com/huggingface/peft/pull/1724\">#1724</a>)"}},{"before":"2558dd872dbacd29f6b60668bfee54b594bcbd7f","after":"47b3712898539569c02ec5b3ed4a6c36811331a1","ref":"refs/heads/main","pushedAt":"2024-05-14T09:38:02.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"DOC Document the PEFT checkpoint format (#1717)\n\nDescription of the PEFT checkpoint format and what it takes to convert\r\nto it.\r\n\r\n---------\r\n\r\nCo-authored-by: Stas Bekman <stas00@users.noreply.github.com>\r\nCo-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>\r\nCo-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>","shortMessageHtmlLink":"DOC Document the PEFT checkpoint format (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2285691105\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1717\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1717/hovercard\" href=\"https://github.com/huggingface/peft/pull/1717\">#1717</a>)"}},{"before":"23e40cdc011d7f41e835f3cbd9ee813036e5d5d3","after":null,"ref":"refs/heads/add-emoji-docker","pushedAt":"2024-05-13T15:27:05.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"}},{"before":"6f41990da482dba96287da64a3c7d3c441e95e23","after":"2558dd872dbacd29f6b60668bfee54b594bcbd7f","ref":"refs/heads/main","pushedAt":"2024-05-13T15:27:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"Workflow: Add slack messages workflow (#1723)\n\n* add slack messages workflow\r\n\r\n* Update .github/workflows/build_docker_images.yml\r\n\r\n* Update .github/workflows/build_docker_images.yml\r\n\r\n* fix","shortMessageHtmlLink":"Workflow: Add slack messages workflow (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2289270057\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1723\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1723/hovercard\" href=\"https://github.com/huggingface/peft/pull/1723\">#1723</a>)"}},{"before":"b6e84597367d959767eb00a26e1e653a1a4a0dd1","after":"23e40cdc011d7f41e835f3cbd9ee813036e5d5d3","ref":"refs/heads/add-emoji-docker","pushedAt":"2024-05-13T14:38:29.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"Merge branch 'add-emoji-docker' of https://github.com/huggingface/peft into add-emoji-docker","shortMessageHtmlLink":"Merge branch 'add-emoji-docker' of <a href=\"https://github.com/huggingface/peft\">https://github.com/huggingface/peft</a> …"}},{"before":"e7c7228b92f70dbdc59df56ab02c42c679edb1b6","after":"b6e84597367d959767eb00a26e1e653a1a4a0dd1","ref":"refs/heads/add-emoji-docker","pushedAt":"2024-05-13T09:27:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"Update .github/workflows/build_docker_images.yml","shortMessageHtmlLink":"Update .github/workflows/build_docker_images.yml"}},{"before":"dd5f11a252b78c3a0e6ebac9dd3bed2ef5803b70","after":"e7c7228b92f70dbdc59df56ab02c42c679edb1b6","ref":"refs/heads/add-emoji-docker","pushedAt":"2024-05-13T09:27:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"Update .github/workflows/build_docker_images.yml","shortMessageHtmlLink":"Update .github/workflows/build_docker_images.yml"}},{"before":"d8fec400c7b26c191830bef5f53ea0f23daf0443","after":"6f41990da482dba96287da64a3c7d3c441e95e23","ref":"refs/heads/main","pushedAt":"2024-05-10T09:47:52.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FIX Trailing ws in revise run_peft_multigpu.sh (#1722)","shortMessageHtmlLink":"FIX Trailing ws in revise run_peft_multigpu.sh (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2288947977\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1722\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1722/hovercard\" href=\"https://github.com/huggingface/peft/pull/1722\">#1722</a>)"}},{"before":null,"after":"dd5f11a252b78c3a0e6ebac9dd3bed2ef5803b70","ref":"refs/heads/add-emoji-docker","pushedAt":"2024-05-10T08:30:56.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"add slack messages workflow","shortMessageHtmlLink":"add slack messages workflow"}},{"before":"32f38788705b15f3aa718057a8f361969e63d273","after":"d8fec400c7b26c191830bef5f53ea0f23daf0443","ref":"refs/heads/main","pushedAt":"2024-05-09T10:19:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"DOC Fix incorrect method name (#1719)","shortMessageHtmlLink":"DOC Fix incorrect method name (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2287254325\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1719\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1719/hovercard\" href=\"https://github.com/huggingface/peft/pull/1719\">#1719</a>)"}},{"before":"cb08d095a578bc1cab0d4cc77d13991e4bb337ca","after":"32f38788705b15f3aa718057a8f361969e63d273","ref":"refs/heads/main","pushedAt":"2024-05-07T10:50:19.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"DOC Some small cleanups in docstrings, copyright note (#1714)","shortMessageHtmlLink":"DOC Some small cleanups in docstrings, copyright note (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2281038378\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1714\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1714/hovercard\" href=\"https://github.com/huggingface/peft/pull/1714\">#1714</a>)"}},{"before":"86d086ec377d75bb5d2fa61d50381887cf7806f0","after":"cb08d095a578bc1cab0d4cc77d13991e4bb337ca","ref":"refs/heads/main","pushedAt":"2024-05-07T10:40:46.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"support Cambricon MLUs device (#1687)\n\n* support mlu device\r\n\r\n* rollback\r\n\r\n* up\r\n\r\n* add version check for mlu\r\n\r\n* better accelerate version check for mlu device\r\n\r\n* fix error with make style","shortMessageHtmlLink":"support Cambricon MLUs device (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2268393586\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1687\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1687/hovercard\" href=\"https://github.com/huggingface/peft/pull/1687\">#1687</a>)"}},{"before":"02ae6bcb373d9d9d3bec9ba920d63316418ff64a","after":"86d086ec377d75bb5d2fa61d50381887cf7806f0","ref":"refs/heads/main","pushedAt":"2024-05-07T09:06:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FEAT Helper to check if a model is a PEFT model (#1713)","shortMessageHtmlLink":"FEAT Helper to check if a model is a PEFT model (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2281029114\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1713\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1713/hovercard\" href=\"https://github.com/huggingface/peft/pull/1713\">#1713</a>)"}},{"before":"77b7238b907c85f21ec756176351d85faf2aeaad","after":"02ae6bcb373d9d9d3bec9ba920d63316418ff64a","ref":"refs/heads/main","pushedAt":"2024-05-03T13:43:27.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"younesbelkada","name":"Younes Belkada","path":"/younesbelkada","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/49240599?s=80&v=4"},"commit":{"message":"Add LoRA support to HQQ Quantization (#1618)\n\n* Add HQQ Lora\r\n\r\n* fix error weight load\r\n\r\n* Remove unused\r\n\r\n* Add quantized lora\r\n\r\n* fix make HQQLinear\r\n\r\n* Fix dtype\r\n\r\n* Revert back quantize lora\r\n\r\n* Add prepare training for hqq quantization\r\n\r\n* Forget revert hqq\r\n\r\n* Remove warnings\r\n\r\n* Other ways to check hqq quantization\r\n\r\n* Add unit test for training\r\n\r\n* change bfloat16 to float16\r\n\r\n* Fix load weight when applied dora\r\n\r\n* Move import hqq inside if clause\r\n\r\n* Naming using CamelCase\r\n\r\n* Remove unused function and fix naming convention\r\n\r\n* Pop offload_meta\r\n\r\n* Add use_dora params\r\n\r\n* Remove confusing comments\r\n\r\n* Additional test for checking output from HQQ\r\n\r\n* Add license notice\r\n\r\n* Add parameter decorator\r\n\r\n* Redundant calling get_base_layer\r\n\r\n* do make style\r\n\r\n* Remove unused comments\r\n\r\n* Move dispatch_hqq out of if clause\r\n\r\n* make style all scripts\r\n\r\n* Add comment for explanation\r\n\r\n* Mention HQQ to docs\r\n\r\n* Add HQQ to Dockerfile\r\n\r\n* Fix styling\r\n\r\n* Styling scripts\r\n\r\n* Comply with transformers HQQ integration\r\n\r\n* Test fully using transformers\r\n\r\n* Add comments handling HQQ\r\n\r\n* Fix naming problem","shortMessageHtmlLink":"Add LoRA support to HQQ Quantization (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2223228412\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1618\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1618/hovercard\" href=\"https://github.com/huggingface/peft/pull/1618\">#1618</a>)"}},{"before":"3edcebf71319605452ec2dd39e234bebaa14e8ba","after":"77b7238b907c85f21ec756176351d85faf2aeaad","ref":"refs/heads/main","pushedAt":"2024-05-01T03:38:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"pacman100","name":"Sourab Mangrulkar","path":"/pacman100","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13534540?s=80&v=4"},"commit":{"message":"fix the fsdp peft autowrap policy (#1694)\n\n* fix the fsdp peft autowrap policy\n\n* address comment wrt backwards compatibility","shortMessageHtmlLink":"fix the fsdp peft autowrap policy (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2270700383\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1694\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1694/hovercard\" href=\"https://github.com/huggingface/peft/pull/1694\">#1694</a>)"}},{"before":"40339ec75525154fac8b02dea620aa132dd92cc7","after":"cf239a2b1ce5393051714db21264ba8406d7b07d","ref":"refs/heads/smangrul/fix-fsdp-auto-wrap","pushedAt":"2024-04-30T14:16:24.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"pacman100","name":"Sourab Mangrulkar","path":"/pacman100","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13534540?s=80&v=4"},"commit":{"message":"Merge branch 'main' into smangrul/fix-fsdp-auto-wrap","shortMessageHtmlLink":"Merge branch 'main' into smangrul/fix-fsdp-auto-wrap"}},{"before":"e0cb15e2ee4336d0bf35f4903f8faddfa9da2805","after":"3edcebf71319605452ec2dd39e234bebaa14e8ba","ref":"refs/heads/main","pushedAt":"2024-04-30T12:32:20.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"Set experimental dynamo config for compile tests (#1698)\n\nRight now, a lot of tests fail when applying torch.compile to PEFT\r\nmodels. One of the main reasons is that attribute checks (self.foo) on\r\nnn.Modules are not correctly considered.\r\n\r\nThis PR sets an experimental flag that should fix this. However, this is\r\nnot public PyTorch API (yet) and incurs a performance penalty. Still,\r\nit's interesting to see how this affects our tests.\r\n\r\nMore context:\r\nhttps://github.com/pytorch/pytorch/issues/124717#issuecomment-2083235776","shortMessageHtmlLink":"Set experimental dynamo config for compile tests (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2271252286\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1698\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1698/hovercard\" href=\"https://github.com/huggingface/peft/pull/1698\">#1698</a>)"}},{"before":"3ec55f4ac4daae5ce75a53ee766250ca8181d65d","after":"e0cb15e2ee4336d0bf35f4903f8faddfa9da2805","ref":"refs/heads/main","pushedAt":"2024-04-30T11:30:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FIX Use different doc builder docker image (#1697)\n\nSame as in:\r\n\r\nhttps://github.com/huggingface/transformers/blob/c712d05aa8fc8ba3ebe465079bd377d2dc9c2e07/.github/workflows/build_documentation.yml#L19","shortMessageHtmlLink":"FIX Use different doc builder docker image (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2271109926\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1697\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1697/hovercard\" href=\"https://github.com/huggingface/peft/pull/1697\">#1697</a>)"}},{"before":"608a90ded9985ee1c5912d738082bb1fd618902b","after":"3ec55f4ac4daae5ce75a53ee766250ca8181d65d","ref":"refs/heads/main","pushedAt":"2024-04-30T10:21:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"BenjaminBossan","name":"Benjamin Bossan","path":"/BenjaminBossan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6229650?s=80&v=4"},"commit":{"message":"FEAT Add LayerNorm tuning (#1301)\n\nLN tuning based on: https://arxiv.org/abs/2312.11420","shortMessageHtmlLink":"FEAT Add LayerNorm tuning (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2056228135\" data-permission-text=\"Title is private\" data-url=\"https://github.com/huggingface/peft/issues/1301\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/huggingface/peft/pull/1301/hovercard\" href=\"https://github.com/huggingface/peft/pull/1301\">#1301</a>)"}},{"before":"20ebeee754b2c23e1cf389af934d0aaf9cdcff2c","after":"40339ec75525154fac8b02dea620aa132dd92cc7","ref":"refs/heads/smangrul/fix-fsdp-auto-wrap","pushedAt":"2024-04-30T09:42:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"pacman100","name":"Sourab Mangrulkar","path":"/pacman100","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13534540?s=80&v=4"},"commit":{"message":"address comment wrt backwards compatibility","shortMessageHtmlLink":"address comment wrt backwards compatibility"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAETSGtdwA","startCursor":null,"endCursor":null}},"title":"Activity · huggingface/peft"}