-
Notifications
You must be signed in to change notification settings - Fork 375
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Training Time of Reranker #782
Comments
We trained for 4 days on 8 * 40G A100 GPUs. During training, the total length of query plus passage was 1024, and the batch size was 128. |
Thank you for you quick follow up. Sorry I have another question: How many epoch you trained on all m3+fever+quora data? Do you do any downsampling? |
Training for 1-2 epochs is enough. |
Thanks for the reply. Sorry I have more questions here.
|
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Thanks for the great work and the open-source models. BTW, I am quite interested in the following questions.
Many thanks!
The text was updated successfully, but these errors were encountered: