Comparing object detection YOLOv5 6.2 with YOLOv8

Dave Lonsdale

Pulling my weight
Dec 3, 2015
459
195
Congleton Edge, UK
Happy New Year guys

I've been using YOLOv5 6.2 ipcam-dark with ipcam-animal for a long time. It's good but not perfect and so decided to give YOLOv8 a go. There isn't a v8 custom model identifying vehicle and animal types so used the default model. I installed and started both v5 and v8 default models at the same time on the same PC to compare the same events triggered by BI.

In good daylight, there's mostly nothing to choose between them in time or confidence, the one that analyses first appears to be random. Example below. So why not use v8, the latest and greatest? I do notice, however, that the default v8 is rather carefree in the range of objects it picks up. I suppose that there is an argument for capturing a robber making off with my pot plant or TV, but would I ever need to identify a frisbee in flight??? It's a shame I don't know how to delete unwanted objects and their images from the list.

The real problems start in poor light. I attach several files that don't make it easy to choose between them except that v8 misses one example completely. What I would really like to compare is custom v5 ipcam-dark + ipam-animal against the default v8 at the same time when it's darker. I've put all the right files in the right folders and rebooted etc but failed to make it work. I've tried editing the v5 RuntimeLocation "shared" in Modulesettings.json without success - it's far beyond my competence. I don't suppose there's a knowledgeable person out there to give me what may be that key piece of information - is there please? Files attacehed.

Default models in good light , both YOLOv5 6.2 and YOLOv8 analysed well.pngYOLOv5 analayses 1800msec later.pngYOLOv5 only dog.pngYOLOv8 analysis first.pngYOLOv8 bear and dog.pngYOLOv8 misses this completely.pngcustom models do not appear.pngcustom models in the camera.pngcustom models in the folder.pngRuntimeLocation shared in Modulesetting.json.png
 
Happy New Year guys

I've been using YOLOv5 6.2 ipcam-dark with ipcam-animal for a long time. It's good but not perfect and so decided to give YOLOv8 a go. There isn't a v8 custom model identifying vehicle and animal types so used the default model. I installed and started both v5 and v8 default models at the same time on the same PC to compare the same events triggered by BI.

In good daylight, there's mostly nothing to choose between them in time or confidence, the one that analyses first appears to be random. Example below. So why not use v8, the latest and greatest? I do notice, however, that the default v8 is rather carefree in the range of objects it picks up. I suppose that there is an argument for capturing a robber making off with my pot plant or TV, but would I ever need to identify a frisbee in flight??? It's a shame I don't know how to delete unwanted objects and their images from the list.

The real problems start in poor light. I attach several files that don't make it easy to choose between them except that v8 misses one example completely. What I would really like to compare is custom v5 ipcam-dark + ipam-animal against the default v8 at the same time when it's darker. I've put all the right files in the right folders and rebooted etc but failed to make it work. I've tried editing the v5 RuntimeLocation "shared" in Modulesettings.json without success - it's far beyond my competence. I don't suppose there's a knowledgeable person out there to give me what may be that key piece of information - is there please? Files attacehed.

View attachment 211378View attachment 211379View attachment 211380View attachment 211381View attachment 211382View attachment 211383View attachment 211384View attachment 211385View attachment 211386View attachment 211387
The custom models are not showing up in the custom model list, restart Blue Iris service and it should update

1736095122395.png
 
Mike, I'm honored you found the time to reply to the likes of me - thank you. I had seen that the "Use custom folders" field was blank so knew it wasn't working. I used Task Manager to restart the BI service (Run as a Windows service is definitely checked). Unfortunately, it made no difference and is still blank (nor rebooting the pc). Oddly, custom v8 does populate that field which is why I tried changing "shared" and "local" in the json file. Perhaps I inadvertently screwed up in some other way which precludes custom v5 from working when the v8 module is also running (both show green in CPAI status with no red lines)

Being the guy with the most amount of relevant information on the planet, would you perhaps suggest that I abandon this exercise? Just tell me - is the default v8 image analysis as good or even better than ipcam-dark?

Thanks again, Dave
 
Just to let you know that the V5 models are not compatible with the V8 module and V8 models are not compatible with the V5 module. You should only have one Object Detection module enabled

Also uncheck Auto start/configure: this causes issues with CodeProject.AI, it was added for DeepStack.

1736106113105.png
 
OK Mike, many thanks for your help. I had checked Auto start/configure when trying to figure out what was wrong. I'll take that as a lesson not to change several things at the same time without making a record.

I'll run only with default v8 object detection for a while and then decide in due course if I think it's best for me.

Kind regards
Dave