Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Active learning NER #364

Open
tianchiguaixia opened this issue Nov 13, 2023 · 4 comments
Open

Active learning NER #364

tianchiguaixia opened this issue Nov 13, 2023 · 4 comments
Labels
feat/model Feature: models

Comments

@tianchiguaixia
Copy link

For example, I want to take a space_ Llm, perform NER auxiliary annotation. With my corrections and updates, how can I let the model know more information and actively learn

@rmitsch rmitsch added the feat/model Feature: models label Nov 13, 2023
@rmitsch
Copy link
Collaborator

rmitsch commented Nov 13, 2023

Hi @tianchiguaixia! If your goal is to perform active learning, LLMs are likely not the way to go at this point. Instead you might want to look into active learning with smaller models.

Prodigy is an annotation tool that is build around this idea, I recommend checking it out.

@tianchiguaixia
Copy link
Author

Can we achieve something similar https://github.com/HumanSignal/Adala

@rmitsch
Copy link
Collaborator

rmitsch commented Dec 6, 2023

Adala and Prodigy have overlapping, but not identical, feature sets. It depends on what exactly you want to achieve.

@tianchiguaixia
Copy link
Author

I recently tried spacy_ LLM and prodigy. Very good!This prodigy is exactly the kind of proactive learning I want

Rec.0008.mp4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat/model Feature: models
Projects
None yet
Development

No branches or pull requests

2 participants