Been experimenting with deepstack performance and wanted to share some quick results
x86 setup
Intel i7 10700K 32GB
Dockerized deepstack
arm64 setup
raspberrypi 4 with 8GB + intel compute stick
Dockerized deepstack
Sample results below (Both sets are from the same video clip from a doorbell camera which is observing a mix of people and street scenery (cars, foliage, etc))
intel i7 10700K
raspberry pi with intel compute stick
Summary:
This is certainly an apples to oranges comparison, but hopefully it'll help anyone curious about performance differences. The more powerful i7 wins out with performance about 4-6x faster detection speed, but the low cost of an RPI + intel compute stick is compelling.
x86 setup
Intel i7 10700K 32GB
Dockerized deepstack
arm64 setup
raspberrypi 4 with 8GB + intel compute stick
Dockerized deepstack
Sample results below (Both sets are from the same video clip from a doorbell camera which is observing a mix of people and street scenery (cars, foliage, etc))
intel i7 10700K
Bash:
[GIN] 2022/01/29 - 13:36:29 | 200 | 144.0811ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:29 | 200 | 235.0075ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:29 | 200 | 145.8144ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:29 | 200 | 208.6846ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:29 | 200 | 155.6102ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:30 | 200 | 253.5007ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:30 | 200 | 147.7443ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:30 | 200 | 280.3374ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:30 | 200 | 158.757ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:31 | 200 | 256.149ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:31 | 200 | 156.2366ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:31 | 200 | 276.6197ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:31 | 200 | 138.5007ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 | 245.3834ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:32 | 200 | 142.9165ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 | 227.2236ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:32 | 200 | 161.8928ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 | 225.4481ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 | 150.2783ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:33 | 200 | 233.6359ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 | 147.5255ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:33 | 200 | 236.678ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 | 137.8911ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 | 253.5469ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:34 | 200 | 145.2642ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 | 238.0903ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:34 | 200 | 162.7617ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 | 241.8945ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:35 | 200 | 144.4725ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:35 | 200 | 282.9614ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:35 | 200 | 268.3662ms | 172.19.0.1 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:36 | 200 | 163.2668ms | 172.19.0.1 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:36 | 200 | 161.1319ms | 172.19.0.1 | POST "/v1/vision/detection"raspberry pi with intel compute stick
Bash:
[GIN] 2022/01/29 - 13:31:02 | 200 | 628.507234ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:31:03 | 200 | 565.178846ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:31:03 | 200 | 545.20545ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:05 | 200 | 1.1637142s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:05 | 200 | 1.185697217s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:10 | 200 | 4.287451304s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 | 4.973740657s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 | 4.855885109s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 | 4.909537283s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 | 4.264715478s | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:12 | 200 | 717.70289ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:12 | 200 | 633.380371ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:13 | 200 | 659.939259ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:14 | 200 | 523.52719ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:14 | 200 | 668.78562ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:15 | 200 | 537.773452ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:15 | 200 | 625.981089ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:16 | 200 | 646.493254ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:17 | 200 | 713.380195ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:17 | 200 | 594.163669ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:18 | 200 | 668.415426ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:19 | 200 | 612.091011ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:19 | 200 | 668.137168ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:20 | 200 | 581.065402ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:21 | 200 | 731.903696ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:21 | 200 | 544.288218ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:22 | 200 | 672.054963ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:23 | 200 | 590.767033ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:23 | 200 | 752.856687ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:24 | 200 | 619.732785ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:25 | 200 | 699.337323ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:25 | 200 | 564.60764ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:26 | 200 | 656.19117ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:26 | 200 | 497.768181ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:27 | 200 | 616.710227ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:28 | 200 | 494.753658ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:28 | 200 | 625.7175ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:29 | 200 | 479.499749ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:29 | 200 | 647.232268ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:30 | 200 | 499.800642ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:31 | 200 | 617.169573ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:31 | 200 | 483.839197ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:32 | 200 | 802.215223ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:32 | 200 | 547.335468ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:33 | 200 | 714.176389ms | 192.168.3.19 | POST "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:34 | 200 | 509.190544ms | 192.168.3.19 | POST "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:34 | 200 | 715.635647ms | 192.168.3.19 | POST "/v1/vision/detection"Summary:
This is certainly an apples to oranges comparison, but hopefully it'll help anyone curious about performance differences. The more powerful i7 wins out with performance about 4-6x faster detection speed, but the low cost of an RPI + intel compute stick is compelling.
