推理mmgrounddino报错！ #12399
Description
python demo/image_demo.py demo/demo.jpg configs/grounding_dino/grounding_dino_swin-b_finetune_16xb2_1x_coco.py --weights grounding_dino_swin-b_finetune_16xb2_1x_coco_20230921_153201-f219e0c0.pth --texts 'bench . car .'
[2025-09-03 12:59:21,797] [INFO] [real_accelerator.py:158:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Loads checkpoint by local backend from path: grounding_dino_swin-b_finetune_16xb2_1x_coco_20230921_153201-f219e0c0.pth
The model and loaded state dict do not match exactly
unexpected key in source state_dict: language_model.language_backbone.body.model.embeddings.position_ids
09/03 12:59:24 - mmengine - WARNING - Failed to search registry with scope "mmdet" in the "function" registry tree. As a workaround, the current "function" registry in "mmengine" is used to build instance. This may cause unexpected failure when running the built modules. Please check whether "mmdet" is a correct scope, or whether the registry is initialized.
/opt/conda/lib/python3.8/site-packages/mmengine/visualization/visualizer.py:196: UserWarning: Failed to add <class 'mmengine.visualization.vis_backend.LocalVisBackend'>, please provide the save_dir argument.
warnings.warn(f'Failed to add {vis_backend.class}, '
[nltk_data] Downloading package punkt to ~/nltk_data...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package averaged_perceptron_tagger to
[nltk_data] ~/nltk_data...
[nltk_data] Package averaged_perceptron_tagger is already up-to-
[nltk_data] date!
Inference ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
Traceback (most recent call last):
File "demo/image_demo.py", line 192, in
main()
File "demo/image_demo.py", line 184, in main
inferencer(**call_args)
File "/data/mmdetection/mmdet/apis/det_inferencer.py", line 403, in call
preds = self.forward(data, **forward_kwargs)
File "/opt/conda/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/mmengine/infer/infer.py", line 296, in forward
return self.model.test_step(inputs)
File "/opt/conda/lib/python3.8/site-packages/mmengine/model/base_model/base_model.py", line 145, in test_step
return self._run_forward(data, mode='predict') # type: ignore
File "/opt/conda/lib/python3.8/site-packages/mmengine/model/base_model/base_model.py", line 361, in _run_forward
results = self(**data, mode=mode)
File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/data/mmdetection/mmdet/models/detectors/base.py", line 94, in forward
return self.predict(inputs, data_samples)
File "/data/mmdetection/mmdet/models/detectors/grounding_dino.py", line 526, in predict
self.get_tokens_positive_and_prompts(
File "/data/mmdetection/mmdet/models/detectors/grounding_dino.py", line 252, in get_tokens_positive_and_prompts
self.get_tokens_and_prompts(
File "/data/mmdetection/mmdet/models/detectors/grounding_dino.py", line 179, in get_tokens_and_prompts
tokens_positive, noun_phrases = run_ner(original_caption)
File "/data/mmdetection/mmdet/models/detectors/glip.py", line 79, in run_ner
noun_phrases = find_noun_phrases(caption)
File "/data/mmdetection/mmdet/models/detectors/glip.py", line 38, in find_noun_phrases
pos_tags = nltk.pos_tag(tokens)
File "/opt/conda/lib/python3.8/site-packages/nltk/tag/init.py", line 165, in pos_tag
tagger = _get_tagger(lang)
File "/opt/conda/lib/python3.8/site-packages/nltk/tag/init.py", line 107, in _get_tagger
tagger = PerceptronTagger()
File "/opt/conda/lib/python3.8/site-packages/nltk/tag/perceptron.py", line 167, in init
find("taggers/averaged_perceptron_tagger/" + PICKLE)
File "/opt/conda/lib/python3.8/site-packages/nltk/data.py", line 555, in find
return find(modified_name, paths)
File "/opt/conda/lib/python3.8/site-packages/nltk/data.py", line 542, in find
return ZipFilePathPointer(p, zipentry)
File "/opt/conda/lib/python3.8/site-packages/nltk/compat.py", line 41, in _decorator
return init_func(*args, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/nltk/data.py", line 394, in init
zipfile = OpenOnDemandZipFile(os.path.abspath(zipfile))
File "/opt/conda/lib/python3.8/site-packages/nltk/compat.py", line 41, in _decorator
return init_func(*args, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/nltk/data.py", line 935, in init
zipfile.ZipFile.init(self, filename)
File "/opt/conda/lib/python3.8/zipfile.py", line 1269, in init
self._RealGetContents()
File "/opt/conda/lib/python3.8/zipfile.py", line 1336, in _RealGetContents
raise BadZipFile("File is not a zip file")
zipfile.BadZipFile: File is not a zip file