Skip to content

Releases: lucidrains/speculative-decoding

0.1.2

04 Oct 16:16
Compare
Choose a tag to compare
generalize to any number of leading start tokens for prophet

0.1.1

04 Oct 15:43
Compare
Choose a tag to compare
the extra norm in projecting to prophet model dimensions hurt for som…

…e reason

0.1.0

03 Oct 14:59
Compare
Choose a tag to compare
complete speculative sampling with prophet net on cached embeddings i…

…dea!

0.0.15

02 Oct 17:27
Compare
Choose a tag to compare
fix start token and determining input sequence

0.0.14

02 Oct 16:45
Compare
Choose a tag to compare
move towards completing what is started

0.0.12

01 Oct 18:22
Compare
Choose a tag to compare
more fixes

0.0.11

26 Sep 16:50
Compare
Choose a tag to compare
just copy batched spec decoding and make batch early exit strategy work

0.0.10

23 Sep 16:15
Compare
Choose a tag to compare
0.0.10

0.0.9

22 Sep 21:29
Compare
Choose a tag to compare
make batched spec decoding work

0.0.8

22 Sep 19:22
Compare
Choose a tag to compare
necessary setup for batched speculative decoding