If you just started CP.AI the first detections for a model will be slow because the model needs to be loaded into memory. Once it is loaded speeds should be back to normal. This was done to save on memory usage.
If you run a detection a second time does the speed improve.
I mean I guess so? I'm still seeing some detections take over 600ms and that was rare on the previous Beta:
2022-09-23 23:24:10: Module 'Object Detection (YOLO)' (command: custom) took 137ms
2022-09-23 23:24:10: Sending response for request from detection_queue took 4ms
2022-09-23 23:24:21: Retrieved detection_queue command
2022-09-23 23:24:21: Detecting using delivery
2022-09-23 23:24:21: Module 'Object Detection (YOLO)' (command: custom) took 155ms
2022-09-23 23:24:21: Sending response for request from detection_queue took 4ms
2022-09-23 23:24:23: Retrieved detection_queue command
2022-09-23 23:24:23: Detecting using ipcam-dark
2022-09-23 23:24:24: Module 'Object Detection (YOLO)' (command: custom) took
1007ms
2022-09-23 23:24:24: Sending response for request from detection_queue took 3ms
I will let it run its course until noon tomorrow and make an assessment and report back.