You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
My own task or dataset (give details below)
Reproduction (minimal, reproducible, runnable)
I'm following this link to convert HuggingFaceH4/zephyr-7b-beta into a neuron model. When I use this command optimum-cli export neuron -m HuggingFaceH4/zephyr-7b-beta --batch_size 4 --sequence_length 2048 --num_cores 2 --auto_cast_type bf16 ./zephyr-7b-beta-neuron, I encounter the following error:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/envs/inf/bin/optimum-cli", line 8, in <module>
sys.exit(main())
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/optimum_cli.py", line 153, in main
register_optimum_cli_subcommand(command_or_command_info, parent_command=parent_command_instance)
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/optimum_cli.py", line 133, in register_optimum_cli_subcommand
parent_command.register_subcommand(command_info)
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/base.py", line 135, in register_subcommand
self.registered_subcommands.append(command_info.subcommand_class(self.subparsers, command=command_info))
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/export/neuronx.py", line 105, in __init__
super().__init__(
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/base.py", line 87, in __init__
self.parse_args(self.parser)
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/export/neuronx.py", line 112, in parse_args
return parse_args_neuronx(parser)
File "/home/ubuntu/anaconda3/envs/inf/lib/python3.10/site-packages/optimum/commands/export/neuronx.py", line 46, in parse_args_neuronx
f" {str(list(TasksManager._TASKS_TO_AUTOMODELS.keys()))}."
AttributeError: type object 'TasksManager' has no attribute '_TASKS_TO_AUTOMODELS'
The error pops up regardless of optimum-cli commands, e.g., solely run optimum-cli.
Expected behavior
Expect optimum-cli can successfully convert zephyr as demo-ed in link.
The text was updated successfully, but these errors were encountered:
System Info
Python: 3.10 Optimum: 1.18.0 (installed by using `pip install --upgrade --upgrade-strategy eager optimum[neuronx]`) Platform: Ubuntu 20.04.6 LTS
Who can help?
@michaelbenayoun
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
I'm following this link to convert
HuggingFaceH4/zephyr-7b-beta
into a neuron model. When I use this commandoptimum-cli export neuron -m HuggingFaceH4/zephyr-7b-beta --batch_size 4 --sequence_length 2048 --num_cores 2 --auto_cast_type bf16 ./zephyr-7b-beta-neuron
, I encounter the following error:The error pops up regardless of
optimum-cli
commands, e.g., solely runoptimum-cli
.Expected behavior
Expect optimum-cli can successfully convert zephyr as demo-ed in link.
The text was updated successfully, but these errors were encountered: