Pull requests: huggingface/tokenizers
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
change conditional compilation for regex libraries
#1510
opened Apr 23, 2024 by
semaraugusto
Loading…
Add
.editorconfig
and rustfmt.toml
for Consistent Code Formatting
#1508
opened Apr 21, 2024 by
tal7aouy
Loading…
corrected typo in the documentations for pre-tokenizers
#1503
opened Apr 17, 2024 by
GorkaUrbizu
Loading…
Fix unsoundness in
tokenizers::utils::parallelism
#1492
opened Apr 12, 2024 by
albertsgarde
Loading…
Add normalization option to Chinese characters (using OpenCC) and separate symbols from merging
Stale
#473
opened Oct 19, 2020 by
ecchochan
Loading…
remove use of parallel iterators except in batch methods
#308
opened Jun 17, 2020 by
epwalsh
Loading…
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.