之前的很多项目中在使用YOLOv9系列的模型来绘制热力图的时候我选择的是GELAN系列的模型来计算的,后处理部分如下:
def postProcess(self, result):
logits_ = result[:, 4:]
boxes_ = result[:, :4]
sorted, indices = torch.sort(logits_.max(1)[0], descending=True)
return torch.transpose(logits_[0], dim0=0, dim1=1)[indices[0]], torch.transpose(boxes_[0], dim0=0, dim1=1)[indices[0]], xywh2xyxy(torch.transpose(boxes_[0], dim0=0, dim1=1)[indices[0]]).cpu().detach().numpy()
今天我训练了官方新发布的yolov9-t和hyolov9-s系列的模型之后,想要实践分析下轻量级的检测模型热力图的效果,但是在直接计算的时候报错,如下:
报错内容如下:
TypeError: list indices must be integers or slices, not tuple
这个猜测可能是因为YOLOv9模型多了一个分支造成的,这里考虑的解决办法应该有两种:
1、基于YOLOv9系列的模型重新改造后处理逻辑
2、重参数化处理
这里我选择的是第二种,因为基本上不需要改动已有的代码,只需要将训练好的yolov9-t和yolov9-s系列的模型重参数化转化处理即可。
这里我们以yolov9-s为例看下,重参数化的处理方式:
ckpt = torch.load(weights)
model.names = ckpt['model'].names
model.nc = ckpt['model'].nc
idx = 0
for k, v in model.state_dict().items():
if "model.{}.".format(idx) in k:
if idx < 22:
kr = k.replace("model.{}.".format(idx), "model.{}.".format(idx))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.cv2.".format(idx) in k:
kr = k.replace("model.{}.cv2.".format(idx), "model.{}.cv4.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.cv3.".format(idx) in k:
kr = k.replace("model.{}.cv3.".format(idx), "model.{}.cv5.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.dfl.".format(idx) in k:
kr = k.replace("model.{}.dfl.".format(idx), "model.{}.dfl2.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
else:
while True:
idx += 1
if "model.{}.".format(idx) in k:
break
if idx < 22:
kr = k.replace("model.{}.".format(idx), "model.{}.".format(idx))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.cv2.".format(idx) in k:
kr = k.replace("model.{}.cv2.".format(idx), "model.{}.cv4.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.cv3.".format(idx) in k:
kr = k.replace("model.{}.cv3.".format(idx), "model.{}.cv5.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
elif "model.{}.dfl.".format(idx) in k:
kr = k.replace("model.{}.dfl.".format(idx), "model.{}.dfl2.".format(idx+7))
model.state_dict()[k] -= model.state_dict()[k]
model.state_dict()[k] += ckpt['model'].state_dict()[kr]
print(k, "perfectly matched!!")
_ = model.eval()
m_ckpt = {'model': model.half(),
'optimizer': None,
'best_fitness': None,
'ema': None,
'updates': None,
'opt': None,
'git': None,
'date': None,
'epoch': -1}
torch.save(m_ckpt, "yolov9-s.pt")
前后对比如下:
这之后直接加载重参数处理后的yolov9-s-converted.pt权重即可完成热力图的绘制了。
实例效果如下所示:
感兴趣的话也可以自行实践下!