CodeProject.AI Version 2.9.0

Thanks for the reply.

I'm running CPAI in a docker container on Unraid. Did try a complete reïnstall with the 2.9.X versions, but this did not help.

Also tried modifying the modulesettings.json, to add the 2.9.X version which I was installing. But this didn't help either.

Currently wondering what the state of google coral support is? There does not seem to be a lot of activity there.
Not much support, unfortunately. I have a working branch for some changes to support more models on more TPUs and make it faster here:

But the GitHub pull request has been sitting in limbo since June and has accumulated the alpha version of some new features:
  • OpenCV image scaling
  • Numba JIT compilation
  • Hosting models on Hugging Face
  • Testing MD5 file hashes for models
  • YOLOv9
  • Faster

I’d be happy to approve any pull requests if anyone wants to get things working the rest of the way in CPAI. I’ve been busy with other projects and haven’t had time to put into this. It mainly just needs testing and getting things figured out with the HF model downloads.

You can see the framerate I’ve gotten with various files and TPU counts in the options.py file in that branch.

Edit: Google hasn’t been doing well supporting the Coral TPU.
If the problem is that the Coral driver is too old and incompatible with current libraries, there is an updated repo to build from. He has done a good job of it:
GitHub - feranick/libcoral: C++ API for ML inferencing and transfer-learning on Coral devices
GitHub - feranick/libedgetpu: Source code for the userspace level runtime driver for Coral.ai devices.
GitHub - feranick/pycoral: Python API for ML inferencing and transfer-learning on Coral devices

I don't know if it will make things more stable and less of a pain, but it's unlikely to be worse...
 
  • Like
Reactions: slidermike