{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":422274596,"defaultBranch":"main","name":"ColossalAI","ownerLogin":"hpcaitech","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2021-10-28T16:19:44.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/88699314?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717155679.0","currentOid":""},"activityList":{"items":[{"before":"c46e09715cc906b9c82a92f1287bd1b1defe87ea","after":"b9d646fe9e2880203cda6fa9b6465aef131db354","ref":"refs/heads/main","pushedAt":"2024-06-05T07:04:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[misc] fix dist logger (#5782)","shortMessageHtmlLink":"[misc] fix dist logger (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2334986997\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5782\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5782/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5782\">#5782</a>)"}},{"before":"3f7e3131d9f0fffbbd62bf7890c8cc94e8992a40","after":"c46e09715cc906b9c82a92f1287bd1b1defe87ea","ref":"refs/heads/main","pushedAt":"2024-06-05T06:26:30.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"Allow building cuda extension without a device. (#5535)\n\nAdded FORCE_CUDA environment variable support, to enable building extensions where a GPU device is not present but cuda libraries are.","shortMessageHtmlLink":"Allow building cuda extension without a device. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2213355125\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5535\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5535/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5535\">#5535</a>)"}},{"before":"10a19e22c63aa9963a889874b63c47ccd0e6db42","after":"3f7e3131d9f0fffbbd62bf7890c8cc94e8992a40","ref":"refs/heads/main","pushedAt":"2024-06-05T06:23:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[gemini] optimize reduce scatter d2h copy (#5760)\n\n* [gemini] optimize reduce scatter d2h copy\r\n\r\n* [fix] fix missing reduce variable\r\n\r\n* [refactor] remove legacy async reduce scatter code\r\n\r\n* [gemini] missing sync\r\n\r\n* Revert \"[refactor] remove legacy async reduce scatter code\"\r\n\r\nThis reverts commit 58ad76d4665032bbe548d066116d1c572ce98979.\r\n\r\n* [gemini] further optimize with async all reduce\r\n\r\n* [fix] pass flag from manager to chunk","shortMessageHtmlLink":"[gemini] optimize reduce scatter d2h copy (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2321407393\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5760\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5760/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5760\">#5760</a>)"}},{"before":"80c3c8789bdfc095618a0b725a4980cd575c6c6b","after":"10a19e22c63aa9963a889874b63c47ccd0e6db42","ref":"refs/heads/main","pushedAt":"2024-06-05T03:29:32.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[hotfix] fix testcase in test_fx/test_tracer (#5779)\n\n* [fix] branch for fix testcase;\r\n\r\n* [fix] fix test_analyzer & test_auto_parallel;\r\n\r\n* [fix] remove local change about moe;\r\n\r\n* [fix] rm local change moe;\r\n\r\n* [fix] fix test_deepfm_model & test_dlrf_model；\r\n\r\n* [fix] fix test_hf_albert & test_hf_gpt;","shortMessageHtmlLink":"[hotfix] fix testcase in test_fx/test_tracer (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2332927475\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5779\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5779/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5779\">#5779</a>)"}},{"before":"79f7a7b211e4e347d006010c9164e3968ce49e6a","after":"80c3c8789bdfc095618a0b725a4980cd575c6c6b","ref":"refs/heads/main","pushedAt":"2024-06-05T03:29:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[Test/CI] remove test cases to reduce CI duration (#5753)\n\n* [test] smaller gpt2 test case\r\n\r\n* [test] reduce test cases: tests/test_zero/test_gemini/test_zeroddp_state_dict.py\r\n\r\n* [test] reduce test cases: tests/test_zero/test_gemini/test_grad_accum.py\r\n\r\n* [test] reduce test cases tests/test_zero/test_gemini/test_optim.py\r\n\r\n* Revert \"[test] smaller gpt2 test case\"\r\n\r\nSome tests might depend on the size of model (num of chunks)\r\n\r\nThis reverts commit df705a5210b8901645992adf276e320e48766ebf.\r\n\r\n* [test] reduce test cases: tests/test_checkpoint_io/test_gemini_checkpoint_io.py\r\n\r\n* [CI] smaller test model for two mwo the two modifid cases\r\n\r\n* [CI] hardcode gpt model for tests/test_zero/test_gemini/test_search.py since we need a fixed answer there","shortMessageHtmlLink":"[Test/CI] remove test cases to reduce CI duration (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2318271402\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5753\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5753/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5753\">#5753</a>)"}},{"before":"50b4c8e8cfe9ebb326433ea45d6ad76dbf9d4a54","after":"79f7a7b211e4e347d006010c9164e3968ce49e6a","ref":"refs/heads/main","pushedAt":"2024-06-05T03:25:19.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Edenzzzz","name":null,"path":"/Edenzzzz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/87317405?s=80&v=4"},"commit":{"message":"[misc] Accelerate CI for zero and dist optim (#5758)\n\n* remove fp16 from lamb\r\n\r\n* remove d2h copy in checking states\r\n\r\n---------\r\n\r\nCo-authored-by: Edenzzzz <wtan45@wisc.edu>","shortMessageHtmlLink":"[misc] Accelerate CI for zero and dist optim (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2318735162\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5758\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5758/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5758\">#5758</a>)"}},{"before":"b45000f839156b252c1708829ca77fe8e4a97453","after":"50b4c8e8cfe9ebb326433ea45d6ad76dbf9d4a54","ref":"refs/heads/main","pushedAt":"2024-06-05T02:56:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[hotfix] fix llama flash attention forward (#5777)","shortMessageHtmlLink":"[hotfix] fix llama flash attention forward (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2332729494\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5777\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5777/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5777\">#5777</a>)"}},{"before":"ee6fd383735320a604259298cf6fd0818e452a3e","after":"b45000f839156b252c1708829ca77fe8e4a97453","ref":"refs/heads/main","pushedAt":"2024-06-05T02:51:20.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yuehuayingxueluo","name":null,"path":"/yuehuayingxueluo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26091437?s=80&v=4"},"commit":{"message":"[Inference]Add Streaming LLM (#5745)\n\n* Add Streaming LLM\r\n\r\n* add some parameters to llama_generation.py\r\n\r\n* verify streamingllm config\r\n\r\n* add test_streamingllm.py\r\n\r\n* modified according to the opinions of review\r\n\r\n* add Citation\r\n\r\n* change _block_tables tolist","shortMessageHtmlLink":"[Inference]Add Streaming LLM (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2311815775\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5745\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5745/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5745\">#5745</a>)"}},{"before":"32f4187806b1e01601adabfaed941162e6a6be60","after":"ee6fd383735320a604259298cf6fd0818e452a3e","ref":"refs/heads/main","pushedAt":"2024-06-04T09:47:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[devops] fix docker ci (#5780)","shortMessageHtmlLink":"[devops] fix docker ci (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2333042830\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5780\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5780/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5780\">#5780</a>)"}},{"before":"e22b82755dd9702a68fd3f8928814c39e282a05a","after":"32f4187806b1e01601adabfaed941162e6a6be60","ref":"refs/heads/main","pushedAt":"2024-06-04T08:15:41.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"FrankLeeeee","name":"Frank Lee","path":"/FrankLeeeee","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/31818963?s=80&v=4"},"commit":{"message":"[misc] update dockerfile (#5776)\n\n* [misc] update dockerfile\r\n\r\n* [misc] update dockerfile","shortMessageHtmlLink":"[misc] update dockerfile (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2332650529\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5776\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5776/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5776\">#5776</a>)"}},{"before":"406443200fcfc087655683d78ce65bddde6d3be2","after":"e22b82755dd9702a68fd3f8928814c39e282a05a","ref":"refs/heads/main","pushedAt":"2024-06-04T05:57:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[CI/tests] simplify some test case to reduce testing time (#5755)\n\n* [ci/tests] simplify some test case to reduce testing time\r\n\r\n* [ci/tests] continue to remove test case to reduce ci time cost\r\n\r\n* restore some test config\r\n\r\n* [ci/tests] continue to reduce ci time cost","shortMessageHtmlLink":"[CI/tests] simplify some test case to reduce testing time (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2318382618\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5755\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5755/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5755\">#5755</a>)"}},{"before":"1b76564e1607aa8cf24566c794977b260de44f6c","after":"406443200fcfc087655683d78ce65bddde6d3be2","ref":"refs/heads/main","pushedAt":"2024-06-03T14:29:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"yuanheng-zhao","name":"Yuanheng Zhao","path":"/yuanheng-zhao","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/54058983?s=80&v=4"},"commit":{"message":"[Hotfix] Add missing init file in inference.executor (#5774)","shortMessageHtmlLink":"[Hotfix] Add missing init file in inference.executor (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2330540735\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5774\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5774/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5774\">#5774</a>)"}},{"before":"3f2be80530ad4ba332b0f375d0493c46fcebe298","after":"1b76564e1607aa8cf24566c794977b260de44f6c","ref":"refs/heads/main","pushedAt":"2024-06-03T07:26:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[test] Fix/fix testcase (#5770)\n\n* [fix] branch for fix testcase;\r\n\r\n* [fix] fix test_analyzer & test_auto_parallel;\r\n\r\n* [fix] remove local change about moe;\r\n\r\n* [fix] rm local change moe;","shortMessageHtmlLink":"[test] Fix/fix testcase (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2330108164\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5770\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5770/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5770\">#5770</a>)"}},{"before":"68359ed1e191a5e1f0817da764b14da73a33ea72","after":"3f2be80530ad4ba332b0f375d0493c46fcebe298","ref":"refs/heads/main","pushedAt":"2024-06-03T03:25:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"flybird11111","name":null,"path":"/flybird11111","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/37931082?s=80&v=4"},"commit":{"message":"fix (#5765)","shortMessageHtmlLink":"fix (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2325044650\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5765\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5765/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5765\">#5765</a>)"}},{"before":"cd48523569398dfc3d418d304ba43fb640d4acd1","after":null,"ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-31T11:40:31.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"}},{"before":"677cbfacf8ef11f423ec1f5216083675615ab85d","after":"68359ed1e191a5e1f0817da764b14da73a33ea72","ref":"refs/heads/main","pushedAt":"2024-05-31T11:40:26.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[release] update version (#5752)\n\n* [release] update version\r\n\r\n* [devops] update compatibility test\r\n\r\n* [devops] update compatibility test\r\n\r\n* [devops] update compatibility test\r\n\r\n* [devops] update compatibility test\r\n\r\n* [test] fix ddp plugin test\r\n\r\n* [test] fix gptj and rpc test\r\n\r\n* [devops] fix cuda ext compatibility\r\n\r\n* [inference] fix flash decoding test\r\n\r\n* [inference] fix flash decoding test","shortMessageHtmlLink":"[release] update version (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2318191919\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5752\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5752/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5752\">#5752</a>)"}},{"before":"1afc57d62ea0b0911b11c3027f661877aa4b013f","after":"cd48523569398dfc3d418d304ba43fb640d4acd1","ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-31T06:15:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[inference] fix flash decoding test","shortMessageHtmlLink":"[inference] fix flash decoding test"}},{"before":"832b6817f8074a331e5309e209d9c377ed294508","after":"1afc57d62ea0b0911b11c3027f661877aa4b013f","ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-31T03:27:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[inference] fix flash decoding test","shortMessageHtmlLink":"[inference] fix flash decoding test"}},{"before":"023ea13cb513bc91d38456a88c4a0e05b245bf32","after":"677cbfacf8ef11f423ec1f5216083675615ab85d","ref":"refs/heads/main","pushedAt":"2024-05-30T05:48:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[Fix/Example] Fix Llama Inference Loading Data Type (#5763)\n\n* [fix/example] fix llama inference loading dtype\r\n\r\n* revise loading dtype of benchmark llama3","shortMessageHtmlLink":"[Fix/Example] Fix Llama Inference Loading Data Type (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2324743912\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5763\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5763/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5763\">#5763</a>)"}},{"before":"061ee4a95e2376c2977cc93d9aaddb34574c7c3b","after":"df6826d2db7827f965d24e7fb2f682b3dfb019ec","ref":"refs/heads/feature/moe","pushedAt":"2024-05-29T08:56:18.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[Feauture] MoE refractor; Intergration with Mixtral  (#5682)\n\n* cherry pick from refractor-moe branch\n\n* tests passed\n\n* [pre-commit.ci] auto fixes from pre-commit.com hooks\n\nfor more information, see https://pre-commit.ci\n\n* support ep + zero\n\n---------\n\nCo-authored-by: Edenzzzz <wtan45@wisc.edu>\nCo-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>","shortMessageHtmlLink":"[Feauture] MoE refractor; Intergration with Mixtral (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2271224022\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5682\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5682/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5682\">#5682</a>)"}},{"before":"8ea9388410246d191e3a46d268d771b663909de0","after":"061ee4a95e2376c2977cc93d9aaddb34574c7c3b","ref":"refs/heads/feature/moe","pushedAt":"2024-05-29T08:22:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[Feauture] MoE refractor; Intergration with Mixtral  (#5682)\n\n* cherry pick from refractor-moe branch\r\n\r\n* tests passed\r\n\r\n* [pre-commit.ci] auto fixes from pre-commit.com hooks\r\n\r\nfor more information, see https://pre-commit.ci\r\n\r\n* support ep + zero\r\n\r\n---------\r\n\r\nCo-authored-by: Edenzzzz <wtan45@wisc.edu>\r\nCo-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>","shortMessageHtmlLink":"[Feauture] MoE refractor; Intergration with Mixtral (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2271224022\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5682\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5682/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5682\">#5682</a>)"}},{"before":null,"after":"023ea13cb513bc91d38456a88c4a0e05b245bf32","ref":"refs/heads/h2d_prefetch","pushedAt":"2024-05-29T07:54:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"botbw","name":"botbw","path":"/botbw","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/67575050?s=80&v=4"},"commit":{"message":"Merge pull request #5749 from hpcaitech/prefetch\n\n[Gemini] Prefetch next chunk before each op","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2313325857\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5749\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5749/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5749\">#5749</a> from hpcaitech/prefetch"}},{"before":"560e22d4511e334ee3c8280e78b9e999df64fe66","after":"832b6817f8074a331e5309e209d9c377ed294508","ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-29T07:36:29.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[devops] fix cuda ext compatibility","shortMessageHtmlLink":"[devops] fix cuda ext compatibility"}},{"before":"154720ba6ee10631added5486eabd1134d480c9e","after":null,"ref":"refs/heads/prefetch","pushedAt":"2024-05-29T07:36:00.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"}},{"before":"b96c6390f4363f58c0df56c0ca28755f8a5f1aa2","after":"023ea13cb513bc91d38456a88c4a0e05b245bf32","ref":"refs/heads/main","pushedAt":"2024-05-29T07:35:54.000Z","pushType":"pr_merge","commitsCount":51,"pusher":{"login":"botbw","name":"botbw","path":"/botbw","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/67575050?s=80&v=4"},"commit":{"message":"Merge pull request #5749 from hpcaitech/prefetch\n\n[Gemini] Prefetch next chunk before each op","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2313325857\" data-permission-text=\"Title is private\" data-url=\"https://github.com/hpcaitech/ColossalAI/issues/5749\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/hpcaitech/ColossalAI/pull/5749/hovercard\" href=\"https://github.com/hpcaitech/ColossalAI/pull/5749\">#5749</a> from hpcaitech/prefetch"}},{"before":"aa93f179bca0fce79aa94891ddaba08dc60d42a5","after":"560e22d4511e334ee3c8280e78b9e999df64fe66","ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-29T07:34:15.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[devops] fix cuda ext compatibility","shortMessageHtmlLink":"[devops] fix cuda ext compatibility"}},{"before":"221806f555b28a6725c4c7a83c8fe9ec628cea6c","after":"aa93f179bca0fce79aa94891ddaba08dc60d42a5","ref":"refs/heads/release/v0.3.8","pushedAt":"2024-05-29T02:32:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"ver217","name":"Hongxin Liu","path":"/ver217","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23111350?s=80&v=4"},"commit":{"message":"[devops] update compatibility test","shortMessageHtmlLink":"[devops] update compatibility test"}},{"before":"d06ec569cd6ac54a5d73d46f4de6e5a567977ef3","after":"5139e681c9e280877f5cafc8ec46583d9f1b7433","ref":"refs/heads/colossalchat_upgrade","pushedAt":"2024-05-29T02:30:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"YeAnbang","name":null,"path":"/YeAnbang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/44796419?s=80&v=4"},"commit":{"message":"update ci","shortMessageHtmlLink":"update ci"}},{"before":"a96701d00ed9c8a9ff06e7eebf2037f49badf669","after":"d06ec569cd6ac54a5d73d46f4de6e5a567977ef3","ref":"refs/heads/colossalchat_upgrade","pushedAt":"2024-05-29T02:25:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"YeAnbang","name":null,"path":"/YeAnbang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/44796419?s=80&v=4"},"commit":{"message":"remove local data path","shortMessageHtmlLink":"remove local data path"}},{"before":"78e3031494f5b2b625230935707536e60b432057","after":"a96701d00ed9c8a9ff06e7eebf2037f49badf669","ref":"refs/heads/colossalchat_upgrade","pushedAt":"2024-05-29T02:10:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"YeAnbang","name":null,"path":"/YeAnbang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/44796419?s=80&v=4"},"commit":{"message":"remove models that require huggingface auth from ci","shortMessageHtmlLink":"remove models that require huggingface auth from ci"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEXMjddgA","startCursor":null,"endCursor":null}},"title":"Activity · hpcaitech/ColossalAI"}