Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in 12_Fine_tuning_Microsoft_Phi_1_5b_on_custom_dataset(dialogstudio) #4

Open
noe opened this issue Mar 2, 2024 · 0 comments
Open

Comments

@noe
Copy link

noe commented Mar 2, 2024

In the notebook from the title, the following line raises an error:

model = get_peft_model(model, peft_config)

The error is the following:

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
[<ipython-input-20-2327ea630778>](https://localhost:8080/#) in <cell line: 1>()
----> 1 model = get_peft_model(model, peft_config)
      2 model.print_trainable_parameters()

5 frames
[/usr/local/lib/python3.10/dist-packages/peft/tuners/tuners_utils.py](https://localhost:8080/#) in inject_adapter(self, model, adapter_name)
    303 
    304         if not is_target_modules_in_base_model:
--> 305             raise ValueError(
    306                 f"Target modules {peft_config.target_modules} not found in the base model. "
    307                 f"Please check the target modules and try again."

ValueError: Target modules {'Wqkv', 'out_proj'} not found in the base model. Please check the target modules and try again.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant