Add aggregation_strategy + start end tokens in TokenClassificationPipeline #750
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Th3G33k
commented
May 10, 2024
•
Th3G33k
commented
- TokenClassificationPipeline aggregation_strategy
- TokenClassificationPipeline start end char
- QuestionAnsweringPipeline start end char
- Tokenizer return_offsets_mapping
- Similar to Python transformers
- Marked as TODO in the code
- Close Is 'aggregation_strategy' parameter available for token classification pipeline? #633
- Close [Feature request] Return offset mapping using tokenizer #425
Requires dynamic imports
* Add RawAudio class and 'save to wav' * Apply suggestions from code review Co-authored-by: Joshua Lochner <admin@xenova.com> * RawAudio toBlob() + save() rewrite * Add saveBlob in utils/core.js * RawAudio : Add support 2 channels + interleave * Fix * Fix * simplify type check * RawAudio : improve interleave + change env -> apis * image.js: change env -> apis * env.js remove changes --------- Co-authored-by: Joshua Lochner <admin@xenova.com>
* Add custom task `register_pipeline` * Change model_name in register_pipeline * add custom tasks to SUPPORTED_TASKS * models.js getModelClassFromName + refactor model mapping * models.js fix model mapping * Beautify code * Allow updating existing supported_tasks
* v3: wasmPaths relative path * Onnx InferenceSession logLevel * remove logLevel * set logLevel * Beautify code
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.