Search results
-
M
Which nVidia GPUs are you using?
It's not quite that simple because DL inference actually use tensor cores with FP16 (or int8). I thought this was a great article on the subject: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/#Raw_Performance_Ranking_of_GPUs Unfortunately, it doesn't directly answer your... -
M
CodeProject.AI Version 2.9.0
You would need to check out the code from my fork (‘git clone git@github.com:seth-planet/CodeProject.AI-ObjectDetectionCoral.git’ and ‘git checkout fix_single_fallback’). And then make a few changes in the code to get it running. I basically see three things to work on: File downloading from... -
M
CodeProject.AI Version 2.9.0
Not much support, unfortunately. I have a working branch for some changes to support more models on more TPUs and make it faster here: https://github.com/seth-planet/CodeProject.AI-ObjectDetectionCoral/tree/fix_single_fallback But the GitHub pull request has been sitting in limbo since June and... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
My current code is fast, but not functional in CPAI. It needs to start downloading models correctly from the hugging face repo I mentioned above. https://github.com/seth-planet/CodeProject.AI-ObjectDetectionCoral/tree/fix_single_fallback -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
The short answer is no, that model needs to be reworked to run on Coral. The long answer is yes, I’ve done so and you can download it here: https://huggingface.co/mailseth/coral/blob/main/all_segments_ipcam-general-v8_edgetpu.tflite Unfortunately, I don’t have a good guide for getting it... -
M
Trying to download Codeproject ai server win x64 2.6 5 help!
Related to this? Looks like the site is down and moved. https://www.reddit.com/r/BlueIris/s/a39ADjhVRv -
M
CodeProject.AI Version 2.5
Yeah, I’m afraid that I don’t have much advice for you. It’s been a few months since I looked at the code. The single-TPU fallback would need to be debugged, but I’m not confident what that means or how to do it here. Different versions would be a good way to get things working more easily. -
M
CodeProject.AI Version 2.5
That's what happens when multiple threads hit the old single-TPU code at the same time (or it could be a bug in the multi-TPU code, but it sounds like that's not running). I'd be curious as to why it's falling back to single-TPU; fixing that and running the newer multi-TPU code would likely fix... -
M
CodeProject.AI Version 2.5
FWIW, I’ve been working on a model larger than @MikeLud1 ‘s for a few months, with additional classes for things like packages, license plates, and fire. I’m currently on the fourth iteration. I’ve been using the package ‘fiftyone’ to curate the dataset sourced from a bunch of different sources... -
M
CodeProject.AI Version 2.5
You should put your GPU time up for sale on vast.ai and make some money. :) -
M
CodeProject.AI Version 2.5
You could also use a PCIe extension cable that will run an extra 5-10" and then hang the GPU outside of the case. The cable extensions work well at PCIe 3.0 speeds, but start to throw errors at 4.0 speeds. You may also need to investigate additional power supply if that's something you're... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
Yeah, there are a few available models for Coral, but they all need to be quantized to 8-bits, which reduces accuracy. Hopefully we can get the IPcam-general Coral model released soon. -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
I'm afraid that the module file management & installation stuff is all outside of what I've worked on. I've looked into it before, but haven't made sense of it, unfortunately. I just send Chris a zip file of the compiled models and he has been setting things up to fit in the larger CPAI system... -
M
CodeProject.AI Version 2.5
Did you try something like this? https://www.codeproject.com/Articles/5322557/CodeProject-AI-Server-AI-the-easy-way?fid=1979732&df=90&mpp=25&sort=Position&spc=Relaxed&prof=True&view=Normal&fr=26#xx0xx -
M
CodeProject.AI Version 2.5
Looks like you’re another victim of the numpy v2 release. Look around for what other folks are doing to get around that -
M
CodeProject.AI Version 2.0
FWIW, older models like MobileNet are even lower resolution at 320x320px. I put some tiling functionality into the Coral CPAI module, but don’t expect it to see much use. Maybe if the Coral TPU was more capable, tiling would be more useful, since it would mean running 2x or 4x the number of... -
M
ipcam-general vs ipcam-generals vs ipcam-generaln
Roughly analogous to the speed, size, and accuracy you see in this table: https://github.com/ultralytics/yolov5#pretrained-checkpoints -
M
ipcam-general vs ipcam-generals vs ipcam-generaln
Probably ’small’ and ‘nano’. What are the file sizes? -
M
ipcam-general vs ipcam-generals vs ipcam-generaln
This is one of the better descriptions I know of: https://github.com/MikeLud/CodeProject.AI-Custom-IPcam-Models/pull/3 -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
I’ve been doing this for many years, but still prefer print statements over breakpoints for whatever reason. I’ve been doing all of my testing using a script to run and test the tpu_runner.py code, so I’m not really even that familiar with how things interact within CPAI, and I may not be of... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
As far as an IDE, I’ve used Eclipse, BBEdit, Sublime, and most recently VS Code. My Linux machine that I’ve done my Coral development on I’m using Sublime and the default Linux text editor (simple text?). And EMacs sometimes. Or vi if I have to. And sometimes I’ll work on some prototype code... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
The Coral TPU code is all in python, although some of the failures may be related to the setup configuration/environment. There really isn’t any hardcore coding that you’d need to do. Just figure out how to make the existing code run more reliably via trial and error. Things like refining the... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
It looks like you are attempting to use multi-TPU by default, but something is wrong so it falls back to the old method. If you’re feeling adventurous you could dig into it and figure out what’s wrong and let me know what to change. (But it may be just the installed coral library version, which... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
You should be always able to use the multi-TPU implementation, even if you only have one. Basically the single TPU just refers to the old code base and multi TPU the newer code base that does better threading. That should fix the error that you were seeing. -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
‘Best’ practices is going to be what works best for you. People tend to be pretty happy with the custom IPcam models, but they aren’t really available right now on the TPU. YOLOv8 is the best in theory, but is going to require more compute and so may not be the best for you. Similarly, there may... -
M
CodeProject.ai with License Plate Reader module - HowTo?
Not YOLOv8? I trust your opinion, but am curious why? -
M
CodeProject.ai with License Plate Reader module - HowTo?
I wonder how large of a photo/label pairing dataset you could scrape off of Craigslist or Edmunds? Would probably be more complete in the past ten years. -
M
CodeProject.AI Version 2.5
The easiest way to ‘fix’ the problem you’re seeing would just be to be running the multi-TPU code on your single TPU. Do you see any earlier problems that would show why that’s not working? -
M
Some success with a coral tpu (m.2) with CPAI and BI
Yeah, I wouldn't expect to see much difference between 0.03 FPS and 1.0 FPS as far as analysis load goes. It's going to really only make a difference when everything is moving because it's windy or raining. -
M
CodeProject.AI Version 2.5
Thanks for the report. I haven’t seen that problem before. From the stack trace, it looks like it’s using the original single-TPU code which hasn’t been changed recently (as far as I know.) I’m on my phone now, I’ll take a closer look when I get a chance.