CodeProject.AI Version 2.5

mailseth said:
Do the failed inferences leave any messages in the log file?
Click to expand...
I don't really know what to look for. In searching, I don't see any responses to "fail" or "error".

I do see a bunch of these entries:

2024-04-21 16:26:52: objectdetection_coral_adapter.py: Ï?™äÜ4¬äÕ?®AŽ½Ó>Ó?‘ƒ•™qÃ?eÔ:Á -?=XlÔ€²©¿ Info: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: No interpreter found. Recreating.
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3]), 'shape_signature': array([ 1, 300, 300, 3]), 'dtype': <class 'numpy.uint8'>, 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20]), 'shape_signature': array([ 1, 20]), 'dtype': <class 'numpy.float32'>, 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3]), 'shape_signature': array([ 1, 300, 300, 3]), 'dtype': <class 'numpy.uint8'>, 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20]), 'shape_signature': array([ 1, 20]), 'dtype': <class 'numpy.float32'>, 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: ling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: Response rec'd from Object Detection (Coral) command 'detect' (#reqid 9a696cc7-e136-4150-ba96-3cb36099284c) ['Found car, car, car...'] took 37ms
2024-04-21 16:26:52: Client request 'detect' in queue 'objectdetection_queue' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe)
2024-04-21 16:26:52: Request 'detect' dequeued from 'objectdetection_queue' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe)
2024-04-21 16:26:52: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-21 16:26:52: Response rec'd from Object Detection (Coral) command 'detect' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe) ['Found car, car, car...'] took 12ms

Also these, which I have seen periodically for a long time, they might just be "noise".

2024-04-21 16:23:07: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:12: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:17: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:22: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:27: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:32: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:37: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:42: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:47: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:52: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:57: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:02: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:07: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:12: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:17: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:22: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:27: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:32: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs

But other than that, nothing that shouts out "Error".

HTH
 
It should really never fall back to CPU and it’s something that only happens on a failed instantiation, so there is something wrong with your installation. (I personally think it’s a confusing design choice and it should fail 100% instead of falling back to CPU.)
 
mailseth said:
It should really never fall back to CPU and it’s something that only happens on a failed instantiation, so there is something wrong with your installation. (I personally think it’s a confusing design choice and it should fail 100% instead of falling back to CPU.)
Click to expand...
I can try uninstalling and reinstalling the Coral module and see if that improves it. I don't suppose there is a somewhat easy way to roll back to ver 2.2.0? I could swear that I was seeing zero fails with 2.2.0 I believe.
 
Only the IPcam-general is ready to be used in that repo. Ive sent it along to be included in the next version of CPAI, but I don’t know when that will be or how it’ll be handled.

Unfortunately it also doesn’t run that great on one TPU because the compiler says there is a CPU-only operation halfway through the model so the remaining half of the model is forced to run off-TPU.
 
@MikeLud1 - I updated to 2.6.2 today and my computer doesn't like it. The YOLOv5.net shows not configured to Autostart and when I do start it, it shuts down.

The ALPR (not shown here as I deleted it and rolling back to 2.5.6) wouldn't run either, even though it showed started.

1714069018805.png
 
As luck would have it, it is working now LOL.

I forget, this means it is using the on-board GPU (I thought it said iGPU before but I am not positive)?

1714092757588.png
 
Is it only me that gets much faster times using YOLOv5-6.2 than YOLOv5.net? I'm using a 1660 Super on unRAID with CodeProject.AI 2.6.2 CUDA docker.

IPCAM-General; Person
6.2 gives me around 14ms (84% confidence)
.net gives me around 100ms (76% confidence)
 
hapstabu said:
I can try uninstalling and reinstalling the Coral module and see if that improves it. I don't suppose there is a somewhat easy way to roll back to ver 2.2.0? I could swear that I was seeing zero fails with 2.2.0 I believe.
Click to expand...
@mailseth

I had tried to change the Coral model size from small to medium several days ago. It took a lot of fiddling to get the status to stop displaying CPU Tflite to TPU Tflite.
I am now looking at the log after several days being occupied with other things, and I am seeing lots and lots of these:

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid db3610cd-4954-4a47-af20-83141a945cc4)
2024-04-26 13:01:43: Client request 'detect' in queue 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:43: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:43: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-26 13:01:43: Object Detection (Coral): [ValueError] : Traceback (most recent call last):
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection
result = do_detect(opts, img, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect
return odcs.do_detect(options, image, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect
_, scale = common.set_resized_input(
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input
tensor = input_tensor(interpreter)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor
return interpreter.tensor(tensor_index)()[0]
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:44: Client request 'detect' in queue 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:44: Request 'detect' dequeued from 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:44: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-26 13:01:44: Object Detection (Coral): [ValueError] : Traceback (most recent call last):
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection
result = do_detect(opts, img, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect
return odcs.do_detect(options, image, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect
_, scale = common.set_resized_input(
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input
tensor = input_tensor(interpreter)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor
return interpreter.tensor(tensor_index)()[0]
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:44: Response rec'd from Object Detection (Coral) command 'detect' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:47: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs

I don't recall seeing anything like this before. Also lots of reverting to CPU entries as before.

I have changed back to YOLOv5 .NET. maybe it is more stable.

Again, It seems like the Coral version prior to 2.2.2 ran with next to no failed inferences, is there any way to roll back to that version in CPAI version 2.6.2, or should I try doing a complete uninstall/ reinstall of CPAI 2.6.2 and NOT upgrade the Coral module to 2.2.2?
 
Thanks for the report. I haven’t seen that problem before. From the stack trace, it looks like it’s using the original single-TPU code which hasn’t been changed recently (as far as I know.) I’m on my phone now, I’ll take a closer look when I get a chance.
 
The easiest way to ‘fix’ the problem you’re seeing would just be to be running the multi-TPU code on your single TPU. Do you see any earlier problems that would show why that’s not working?
 
You must log in or register to reply here.
Top Bottom