Skip to content

Pull requests: huggingface/datatrove

New pull request New
6 Open 119 Closed
6 Open 119 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Migrate dedup to xxhash
#179 opened May 7, 2024 by guipenedo Loading…
1
Speedup json writer
#175 opened May 5, 2024 by its5Q Loading…
2
Summary stats
#158 opened Apr 20, 2024 by hynky1999 Loading…
9
[WIP] Multi-Lingual Tokenization
#147 opened Apr 2, 2024 by beme248 Loading…
8
Implement LanguageIdStats Feature and Metadata Check in language_filter
#136 opened Mar 23, 2024 by justHungryMan Loading…
2
Linewise filters
#125 opened Mar 14, 2024 by guipenedo • Draft
ProTip! Type g i on any issue or pull request to go back to the issue listing page.