Unexpected key(s) in state_dict #49

New Issue

2024-01-26T13:02:50+08:00

Wuyuwei-063 commented

2024-01-26 13:02:50 +08:00

(Migrated from github.com)

Hello, many thanks for your wonderful work, when I load the pretrained/midas/dpt_beit_large_512.pt, I meet a RuntimeError as follows:
RuntimeError: Error(s) in loading state_dict for DPTDepthModel:
Unexpected key(s) in state_dict: "pretrained.model.blocks.0.attn.relative_position_index", "pretrained.model.blocks.1.attn.relative_position_index", "pretrained.model.blocks.2.attn.relative_position_index", "pretrained.model.blocks.3.attn.relative_position_index", "pretrained.model.blocks.4.attn.relative_position_index", "pretrained.model.blocks.5.attn.relative_position_index", "pretrained.model.blocks.6.attn.relative_position_index", "pretrained.model.blocks.7.attn.relative_position_index", "pretrained.model.blocks.8.attn.relative_position_index", "pretrained.model.blocks.9.attn.relative_position_index", "pretrained.model.blocks.10.attn.relative_position_index", "pretrained.model.blocks.11.attn.relative_position_index", "pretrained.model.blocks.12.attn.relative_position_index", "pretrained.model.blocks.13.attn.relative_position_index", "pretrained.model.blocks.14.attn.relative_position_index", "pretrained.model.blocks.15.attn.relative_position_index", "pretrained.model.blocks.16.attn.relative_position_index", "pretrained.model.blocks.17.attn.relative_position_index", "pretrained.model.blocks.18.attn.relative_position_index", "pretrained.model.blocks.19.attn.relative_position_index", "pretrained.model.blocks.20.attn.relative_position_index", "pretrained.model.blocks.21.attn.relative_position_index", "pretrained.model.blocks.22.attn.relative_position_index", "pretrained.model.blocks.23.attn.relative_position_index".

Hello, many thanks for your wonderful work, when I load the pretrained/midas/dpt_beit_large_512.pt, I meet a RuntimeError as follows: RuntimeError: Error(s) in loading state_dict for DPTDepthModel: Unexpected key(s) in state_dict: "pretrained.model.blocks.0.attn.relative_position_index", "pretrained.model.blocks.1.attn.relative_position_index", "pretrained.model.blocks.2.attn.relative_position_index", "pretrained.model.blocks.3.attn.relative_position_index", "pretrained.model.blocks.4.attn.relative_position_index", "pretrained.model.blocks.5.attn.relative_position_index", "pretrained.model.blocks.6.attn.relative_position_index", "pretrained.model.blocks.7.attn.relative_position_index", "pretrained.model.blocks.8.attn.relative_position_index", "pretrained.model.blocks.9.attn.relative_position_index", "pretrained.model.blocks.10.attn.relative_position_index", "pretrained.model.blocks.11.attn.relative_position_index", "pretrained.model.blocks.12.attn.relative_position_index", "pretrained.model.blocks.13.attn.relative_position_index", "pretrained.model.blocks.14.attn.relative_position_index", "pretrained.model.blocks.15.attn.relative_position_index", "pretrained.model.blocks.16.attn.relative_position_index", "pretrained.model.blocks.17.attn.relative_position_index", "pretrained.model.blocks.18.attn.relative_position_index", "pretrained.model.blocks.19.attn.relative_position_index", "pretrained.model.blocks.20.attn.relative_position_index", "pretrained.model.blocks.21.attn.relative_position_index", "pretrained.model.blocks.22.attn.relative_position_index", "pretrained.model.blocks.23.attn.relative_position_index".

CGMikeG commented

2024-02-03 19:00:56 +08:00

(Migrated from github.com)

You should have included the whole error code, I ran into the same issue that is the only reason I found the issue.
Under folder midas go to file base_model.py

 if "optimizer" in parameters:
        parameters = parameters["model"]

  self.load_state_dict(parameters)

You need to indent the last line so it looks something like below.

 if "optimizer" in parameters:
        parameters = parameters["model"]

        self.load_state_dict(parameters)

I hope this fix your issue, you may need to do pip install timm==0.6.7 as the current version of timm seem to be incompatible.

Also when you use the sample image in data folder, make sure you check the name of the folder and the file.

You should have included the whole error code, I ran into the same issue that is the only reason I found the issue. Under folder midas go to file base_model.py if "optimizer" in parameters: parameters = parameters["model"] self.load_state_dict(parameters) You need to indent the last line so it looks something like below. if "optimizer" in parameters: parameters = parameters["model"] self.load_state_dict(parameters) I hope this fix your issue, you may need to do pip install timm==0.6.7 as the current version of timm seem to be incompatible. Also when you use the sample image in data folder, make sure you check the name of the folder and the file.

👍 1

guochengqian commented

2024-04-23 04:44:45 +08:00

(Migrated from github.com)

Thanks for the clarification. @CGMikeG

We note timm==0.6.7 is required by midas depth estimation:
937b51f93a/requirements.txt (L58)

Thanks for the clarification. @CGMikeG We note timm==0.6.7 is required by midas depth estimation: https://github.com/guochengqian/Magic123/blob/937b51f93ad98d6ba563fbdf4307ecd7cffc1b24/requirements.txt#L58

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: dearsky/Magic123#49