Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transformers version-up #35

Open
4 tasks
j-min opened this issue Jul 29, 2023 · 0 comments
Open
4 tasks

transformers version-up #35

j-min opened this issue Jul 29, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@j-min
Copy link
Owner

j-min commented Jul 29, 2023

I noticed that the current ipynb demo is failing when installing packages of requirements.txt on colab with Python 3.10 recently. It seems that tokenizers (==0.9.4) which is paired with transformers==4.2.1 is not compatible with Python 3.10 in Colab.

Since I found that changing python version in colab is not trivial, now I'm considering package version-ups so that people can use VL-T5 with recent transformers versions >= 4.31. This might also address tokenization issue #21 relevant to the recent versions of transformers.

Current todos are:

  • update modeling_t5.py
    • T5Stack variable version ups (e.g., use_cache=None -> False / head_mask -> layer_head_mask)
  • check tokenization.py
    • add some test cases comparing tokenization outputs from the old 4.2.1 version and 4.31.0
@j-min j-min added the enhancement New feature or request label Jul 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant