-
Notifications
You must be signed in to change notification settings - Fork 4
Description
(openvino) [root@localhost openvino]# python3 convert.py --model_id /root/Glm4/GLM-4/glm-4-9b-chat/ --precision int8 --output /root/Glm4/Intel/glm-4-9b-chat-ov
====Exporting IR=====
Traceback (most recent call last):
File "/root/Glm4/GLM-4/intel_device_demo/openvino/convert.py", line 61, in
ov_model = OVModelForCausalLM.from_pretrained(args.model_id, export=True,
File "/root/anaconda3/envs/openvino/lib/python3.10/site-packages/optimum/modeling_base.py", line 424, in from_pretrained
return from_pretrained_method(
File "/root/anaconda3/envs/openvino/lib/python3.10/site-packages/optimum/intel/openvino/modeling_decoder.py", line 283, in _from_transformers
main_export(
File "/root/anaconda3/envs/openvino/lib/python3.10/site-packages/optimum/exporters/openvino/main.py", line 194, in main_export
framework = TasksManager.determine_framework(model_name_or_path, subfolder=subfolder, framework=framework)
TypeError: TasksManager.determine_framework() got an unexpected keyword argument 'framework'
Keep popping same error as above, no matter using HF model or local downloaded model,please help me with it, thanks a lot!!