Questions on Evaluation Metrics

[VicZlq]

Thank you very much for your work, we recently tried to add your work for comparison but had some problems with the assessment indicators.

Do you have a reference code for Pose Cosine Similarity-based AP (CAP) and People Count Error (PCE) ? We would like to ensure consistency of values. Thank you very much!:)

[VicZlq]

Thank you very much for your work, we recently tried to add your work for comparison but had some problems with the assessment indicators.

Do you have a reference code for Pose Cosine Similarity-based AP (CAP) and People Count Error (PCE) ? We would like to ensure consistency of values. Thank you very much!:)

[juxuan27]

Hi, @VicZlq . It is provided here. Thank you for your focus.

[VicZlq]

Thank you very much for your reply!
I'm having some problems with the review.
I loaded the humansd-v1.ckpt weights and got a bug when running pose2img_metrics.py:
File "/storage/zhaoliuqing/code/HumanSD/ldm/util.py", line 83, in instantiate_from_config
if not "target" in config.
TypeError: argument of type 'NoneType' is not iterable

I've debugged and it seems that the supplied file does not have a “.model” target in config, have you encountered this problem?

[VicZlq]

Thank you very much for your reply! I'm having some problems with the review. I loaded the humansd-v1.ckpt weights and got a bug when running pose2img_metrics.py: File "/storage/zhaoliuqing/code/HumanSD/ldm/util.py", line 83, in instantiate_from_config if not "target" in config. TypeError: argument of type 'NoneType' is not iterable

I've debugged and it seems that the supplied file does not have a “.model” target in config, have you encountered this problem?

I checked the metrics.yaml code and it seems to be missing model and data settings in there. I copied the model configuration from inference and the problem seems to be solved :)

Do you have the metrics.yaml configuration file that contains the model and data information for inference at that time?

[juxuan27]

Sorry for the late reply. Copying the model configuration from inference is the right way to solve the problem. We will update the yaml file in the revised version. Thank you for pointing out the problem.