Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question]: 是否有脱离paddle和paddlenlp的分词库？ #8356

Closed
cqray1990 opened this issue Apr 30, 2024 · 1 comment
Closed

[Question]: 是否有脱离paddle和paddlenlp的分词库？ #8356

cqray1990 opened this issue Apr 30, 2024 · 1 comment
Assignees
@KB-Ding
Labels
question Further information is requested

Comments

@cqray1990
Copy link

请提出你的问题

我将模型转成onnx，用onnxruntime运行，但是不想调用AutoTokenizer 比如ErnieTokenizer 分词，因为调用的话需要安装paddle 和paddlenlp，是否其他分词替代？
@cqray1990 cqray1990 added the question Further information is requested label Apr 30, 2024
@w5688414
Copy link
Contributor

可以自己写一个，另外，欢迎开发者贡献

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KB-Ding KB-Ding

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@w5688414 @cqray1990 @KB-Ding