We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently Fury xlang serialization use utf8 for string encoding, which is not performance efficient in many languages.
We introduced utf16 in https://fury.apache.org/docs/specification/fury_xlang_serialization_spec#string . But rust native string doesn't support utf16, it's is utf-8 encoded.
We should support to transcode utf16 encoded string to utf8 string in fury rust deserialization.
Implement utf16 to utf8 convertion in fury rust. The implementation should use SIMD to provide faster speed.
#1413
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Is your feature request related to a problem? Please describe.
Currently Fury xlang serialization use utf8 for string encoding, which is not performance efficient in many languages.
We introduced utf16 in https://fury.apache.org/docs/specification/fury_xlang_serialization_spec#string . But rust native string doesn't support utf16, it's is utf-8 encoded.
We should support to transcode utf16 encoded string to utf8 string in fury rust deserialization.
Describe the solution you'd like
Implement utf16 to utf8 convertion in fury rust. The implementation should use SIMD to provide faster speed.
Additional context
#1413
The text was updated successfully, but these errors were encountered: