Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KJSL: If CPU_ARCH is not set, e.g. on Apple Silicon ARM, then use uname #180

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

KJSL: If CPU_ARCH is not set, e.g. on Apple Silicon ARM, then use uname #180

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
21833ad
run completion cpu
IgorKasianenko Apr 20, 2024
576b86e
working notebook and python script
Apr 20, 2024
ac4271d
KJSL: If CPU_ARCH is not set, e.g. on Apple Silicon ARM, then populat…
kevleyski May 2, 2024
10473ba
KJSL Apple Silicon M3 Max
kevleyski May 2, 2024
daf8660
Merge pull request #1 from IgorKasianenko/main
kevleyski May 2, 2024
a01dafd
KJSL Apple Silicon M3 Max
kevleyski May 2, 2024
a81026a
KJSL Apple Silicon M3 Max
kevleyski May 2, 2024
9d08b4e
KJSL gloo default master port
kevleyski May 2, 2024
66cd498
KJSL diff tokenizer
kevleyski May 2, 2024
fc31287
KJSL diff tokenizer
kevleyski May 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
8 changes: 8 additions & 0 deletions .idea/.gitignore
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 10 additions & 0 deletions Meta-Llama-3-70B-Instruct/checklist.chk
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
0982cab45fea5c71090fb4df5693f4b1 consolidated.00.pth
da5e8f9d4281f66829bc39633f0c4d9a consolidated.01.pth
9bc486f4a2571049c992c50e296c70aa consolidated.02.pth
b2411c75d4ef978129dd6cc933fe2f36 consolidated.03.pth
7644993ef3455cf92587d6a5c9409f0d consolidated.04.pth
59cb217ce42ed46a6e8c7bf3ebb87de7 consolidated.05.pth
273073bccc7994c159fdeffe5fbde5f6 consolidated.06.pth
2d1ff76cdae9bc84bfc76ebd0f64b9ba consolidated.07.pth
964ba60980e721f9009f90e6b219b157 params.json
08292403f8b173e7524d7fba7bbbd2d3 tokenizer.model
11 changes: 11 additions & 0 deletions Meta-Llama-3-70B-Instruct/params.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
{
"dim": 8192,
"ffn_dim_multiplier": 1.3,
"multiple_of": 4096,
"n_heads": 64,
"n_kv_heads": 8,
"n_layers": 80,
"norm_eps": 1e-05,
"vocab_size": 128256,
"rope_theta": 500000.0
}