0.1.16

Changes

• Update llama.cpp submodule to latest release b3091 @jan-service-account (#76)
• feat: add cache_type parameter @vansangpfiev (#75)
• Update llama.cpp submodule to latest release b3088 @jan-service-account (#74)
• fix: use inference stop words by default, fallback to loading model stop words @vansangpfiev (#72)
• feat: add stop words when loading model @vansangpfiev (#71)
• Update llama.cpp submodule to latest release b3078 @jan-service-account (#70)
• Update llama.cpp submodule to latest release b3070 @jan-service-account (#69)
• Update llama.cpp submodule to latest release b3051 @jan-service-account (#68)
• Update llama.cpp submodule to latest release b3040 @jan-service-account (#67)

Contributor

@jan-service-account and @vansangpfiev

0.1.15

Changes

• fix: use inference stop words by default, fallback to loading model stop words @vansangpfiev (#72)
• feat: add stop words when loading model @vansangpfiev (#71)
• Update llama.cpp submodule to latest release b3078 @jan-service-account (#70)
• Update llama.cpp submodule to latest release b3070 @jan-service-account (#69)
• Update llama.cpp submodule to latest release b3051 @jan-service-account (#68)
• Update llama.cpp submodule to latest release b3040 @jan-service-account (#67)

Contributor

@jan-service-account and @vansangpfiev

0.1.14

Changes

• feat: add stop words when loading model @vansangpfiev (#71)
• Update llama.cpp submodule to latest release b3078 @jan-service-account (#70)
• Update llama.cpp submodule to latest release b3070 @jan-service-account (#69)
• Update llama.cpp submodule to latest release b3051 @jan-service-account (#68)
• Update llama.cpp submodule to latest release b3040 @jan-service-account (#67)

Contributor

@jan-service-account and @vansangpfiev

0.1.13

Changes

• Update llama.cpp submodule to latest release b3070 @jan-service-account (#69)
• Update llama.cpp submodule to latest release b3051 @jan-service-account (#68)
• Update llama.cpp submodule to latest release b3040 @jan-service-account (#67)

Contributor

@jan-service-account

0.1.12

Changes

• feat: add more info on getting models @vansangpfiev (#66)
• Update llama.cpp submodule to latest release b3029 @jan-service-account (#65)
• fix: use mistra model for submodule e2e @vansangpfiev (#64)
• feat: add python @vansangpfiev (#61)
• feat: separate CI for llama.cpp submodule update @vansangpfiev (#58)
• Add codesign @hiento09 (#59)

Contributor

@hiento09, @jan-service-account and @vansangpfiev

Full Changelog: v0.1.11...v0.1.12

0.1.11

What's Changed

• feat: replace llama_token_eos by llama_token_is_eog by @vansangpfiev in #57
• Update llama.cpp submodule to latest release b3003 by @jan-service-account in #56
• Update llama.cpp submodule to latest release b3012 by @jan-service-account in #62
• feat: change n_batch default to 2048 by @vansangpfiev in #63

Full Changelog: v0.1.10...v0.1.11

0.1.10

What's Changed

• Update llama.cpp submodule to latest release b2985 by @jan-service-account in #53
• fix: small lock improvement by @vansangpfiev in #19

New Contributors

• @jan-service-account made their first contribution in #53

Full Changelog: v0.1.9...v0.1.10

0.1.9

What's Changed

• Chore fix auto sync by @hiento09 in #49
• feat: get running models by @vansangpfiev in #34
• fix: flash attention param typo by @vansangpfiev in #50
• chore: pr sync remote weekdays by @vansangpfiev in #51
• fix: return false if error during loading model by @vansangpfiev in #52

Full Changelog: v0.1.8...v0.1.9

0.1.8

What's Changed

• chore: bump llama.cpp to b2961 by @vansangpfiev in #45

Full Changelog: v0.1.7...v0.1.8

0.1.7

What's Changed

• Add CI auto create PR to update submodule by @hiento09 in #38
• feat: support Flash Attention by @vansangpfiev in #32
• Add trigger CI after create PR by @hiento09 in #43
• Replace deprecated steps github action by @hiento09 in #46

Full Changelog: v0.1.6...v0.1.7