OpenALPR LPR Downloader stopped working?

Joined
Nov 8, 2019
Messages
18
Reaction score
8
Location
Arizona
I don't know how to fix it from our side. This seems to be an internal Rekor server issue. It also appears to be affected by the INT issue I mentioned above. If you look at entries online from yesterday the preview images stop at the same time that the downloader started having the issue.

Before the max INT value for pk was exceeded:
View attachment 132805

After the max INT value for pk was exceeded:
View attachment 132806

Those entries match up with my mySQL database entries from before and after the max INT value for pk was exceeded:
Code:
[LPR]>select  pk, best_plate, epoch_time_start from Plates where pk >= '2147478437' order by pk limit 2;
+------------+------------+---------------------+
| pk         | best_plate | epoch_time_start    |
+------------+------------+---------------------+
| 2147478437 | APYD00     | 2022-07-06 11:15:50 |
| 2147492777 | 178OLQ     | 2022-07-06 11:20:23 |
+------------+------------+---------------------+

Can you see the thumbnails of plate captures when you hover over the Plate Number links in Advanced Search? All of my current and older plate thumbnails appear there, but none of the capture thumbnails appear from the Dashboard for the last 36 hours.

Dashboard -

Dashboard 7-7-2022.png

Advanced Search - Same Capture.

Advanced Search 7-7-2022.png

I've looked thru the configuration items and don't see any that we control that would fix this.
 

Fubduck

Getting the hang of it
Joined
Jul 10, 2018
Messages
109
Reaction score
72
Location
colorado
I can now see recent image thumbnails on the dashboard. However I have data missing for almost 19 hours. From yesterday Jul 7 @ 5:58:06 pm until today Jul 8 @ 12:48:10 pm. I see nothing between these times in the dashboard or in advanced search.
I'm not worried about it as I already had it downloaded into my database.

All times are mountain time.

One thing I noticed is that when the image thumbnails started showing again Rekor reset the pk value back to roughly what it was last night at ~6pm.
My last pk value before 6pm last night was at 5:58:14pm was 2151565177.
The next pk value after 6pm last night was at 6:00:37pm was 2151570996.
My first pk value after the thumbnails started showing up today at 12:48:08pm today was 2151565568.

This coincides with the almost 19 hours of missing data.

Code:
[LPR]>select pk, best_plate, epoch_time_start from Plates where pk >= 2151565176  and pk <= 2151570997 order by pk ;
+------------+------------+---------------------+
| pk         | best_plate | epoch_time_start    |
+------------+------------+---------------------+
| 2151565177 | 835MHS     | 2022-07-07 17:58:14 |
| 2151565568 | CTKC27     | 2022-07-08 12:48:08 |
| 2151570996 | ANBE22     | 2022-07-07 18:00:37 |
+------------+------------+---------------------+

So if I sort by pk the entries are out of order. Sometime tonight the pk value should catch back to where it was before they reset it.
 
Joined
Nov 8, 2019
Messages
18
Reaction score
8
Location
Arizona
I can now see recent image thumbnails on the dashboard. However I have data missing for almost 19 hours. From yesterday Jul 7 @ 5:58:06 pm until today Jul 8 @ 12:48:10 pm. I see nothing between these times in the dashboard or in advanced search.
I'm not worried about it as I already had it downloaded into my database.

All times are mountain time.

One thing I noticed is that when the image thumbnails started showing again Rekor reset the pk value back to roughly what it was last night at ~6pm.
My last pk value before 6pm last night was at 5:58:14pm was 2151565177.
The next pk value after 6pm last night was at 6:00:37pm was 2151570996.
My first pk value after the thumbnails started showing up today at 12:48:08pm today was 2151565568.

This coincides with the almost 19 hours of missing data.

Code:
[LPR]>select pk, best_plate, epoch_time_start from Plates where pk >= 2151565176  and pk <= 2151570997 order by pk ;
+------------+------------+---------------------+
| pk         | best_plate | epoch_time_start    |
+------------+------------+---------------------+
| 2151565177 | 835MHS     | 2022-07-07 17:58:14 |
| 2151565568 | CTKC27     | 2022-07-08 12:48:08 |
| 2151570996 | ANBE22     | 2022-07-07 18:00:37 |
+------------+------------+---------------------+

So if I sort by pk the entries are out of order. Sometime tonight the pk value should catch back to where it was before they reset it.
Rekor Cloud offline? Again?
 
Joined
Nov 8, 2019
Messages
18
Reaction score
8
Location
Arizona
I can now see recent image thumbnails on the dashboard. However I have data missing for almost 19 hours. From yesterday Jul 7 @ 5:58:06 pm until today Jul 8 @ 12:48:10 pm. I see nothing between these times in the dashboard or in advanced search.
I'm not worried about it as I already had it downloaded into my database.

All times are mountain time.

One thing I noticed is that when the image thumbnails started showing again Rekor reset the pk value back to roughly what it was last night at ~6pm.
My last pk value before 6pm last night was at 5:58:14pm was 2151565177.
The next pk value after 6pm last night was at 6:00:37pm was 2151570996.
My first pk value after the thumbnails started showing up today at 12:48:08pm today was 2151565568.

This coincides with the almost 19 hours of missing data.

Code:
[LPR]>select pk, best_plate, epoch_time_start from Plates where pk >= 2151565176  and pk <= 2151570997 order by pk ;
+------------+------------+---------------------+
| pk         | best_plate | epoch_time_start    |
+------------+------------+---------------------+
| 2151565177 | 835MHS     | 2022-07-07 17:58:14 |
| 2151565568 | CTKC27     | 2022-07-08 12:48:08 |
| 2151570996 | ANBE22     | 2022-07-07 18:00:37 |
+------------+------------+---------------------+

So if I sort by pk the entries are out of order. Sometime tonight the pk value should catch back to where it was before they reset it.
Tonight I noticed that two of my computers lost connection to cloud.openalpr.com. Getting a Bad Request 400 error using Edge on one and the LPR downloader on the second computer shows that "the webpage cannot be found." Both of these connections dropped sometime today or yesterday. My network has been up all day.

Finally got reconnected about 9:35PM MST on one computer and mysteriously the license plate thumbnail has returned on the Dashboard.

Getting a 502 Bad Gateway error on the computer running the LPR Downloader, but I'll get that resolved now that I can connect to the Cloud server again.

Looking at the Cloud Dashboard, I have a gap in captures from about 4:45PM yesterday (7-7) until 11:00AM MST today (7-8-2022.) 19 hours of missing data??

I'm thinking this is about the 4th time in as many months that Rekor servers have gone offline that I've noticed.

Another mysterious outage and code fix?
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
I saw those 400 errors as well I am guessing some sort of outage on rekor end..And yet rekor raised there price 60% last year..

But it resolved within couple of hours for me.. Or Actually I should say I had to restart my program after the issue was resolved on rekor end..
 
Joined
Nov 8, 2019
Messages
18
Reaction score
8
Location
Arizona
I saw those 400 errors as well I am guessing some sort of outage on rekor end..And yet rekor raised there price 60% last year..

But it resolved within couple of hours for me.. Or Actually I should say I had to restart my program after the issue was resolved on rekor end..
LPR Downloader, Viewer, and the Rekor Cloud are all working again.

The computer running Downloader gave me the "web page not found' for several hours. I was able to log in to the Cloud on another computer so I knew their website was back up.

Finally got the Rekor logon screen to appear in the Downloader after I deleted all things Internet (cookies, temp files, history) on that computer and restarted.

But I continued to see the blank gray screen showing no imports even after Downloader was connected to Rekor. Stopped and restarted the auto download several times but still no activity was displayed.

Decided to download the csv file from Rekor with the last two days captures and did a manually upload. The activity finally showed 0 imported and 499 skipped. I waited about an hour and stopped and restarted the auto download again and Downloader imported several captures and I see them in Viewer.


Disappointed with Rekor - there have been too many multi-hour outages this year with no explanation and no warning.

Considering this is a fee based service, you would think they would show us the courtesy of advising when they are having scheduled maintenance....

Or are these outages hardware/software/storage failures they don't want to admit??
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
LPR Downloader, Viewer, and the Rekor Cloud are all working again.

The computer running Downloader gave me the "web page not found' for several hours. I was able to log in to the Cloud on another computer so I knew their website was back up.

Finally got the Rekor logon screen to appear in the Downloader after I deleted all things Internet (cookies, temp files, history) on that computer and restarted.

But I continued to see the blank gray screen showing no imports even after Downloader was connected to Rekor. Stopped and restarted the auto download several times but still no activity was displayed.

Decided to download the csv file from Rekor with the last two days captures and did a manually upload. The activity finally showed 0 imported and 499 skipped. I waited about an hour and stopped and restarted the auto download again and Downloader imported several captures and I see them in Viewer.


Disappointed with Rekor - there have been too many multi-hour outages this year with no explanation and no warning.

Considering this is a fee based service, you would think they would show us the courtesy of advising when they are having scheduled maintenance....

Or are these outages hardware/software/storage failures they don't want to admit??
Yeah They have had several outages and that too after the huge price hike already in place.. I wish there was another route or alternative service specially even with current price hikes and all the issues.. :(
 

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
24,438
Reaction score
47,565
Location
USA
Well there is a free solution to read plates with the custom model a member created here for use with Blue Iris, but I wouldn't know where to begin on how to migrate the viewer tool many of us use.
 

tech101

Known around here
Joined
Mar 30, 2015
Messages
1,472
Reaction score
2,125
Location
SF BayArea, USA
Well there is a free solution to read plates with the custom model a member created here for use with Blue Iris, but I wouldn't know where to begin on how to migrate the viewer tool many of us use.
Yea not sure that would probably require to re-write everything from scratch... Now maybe it can become easier if that is outputting a json.. Again not a programmer Dlong or some other programmer on this forum can see if we can come up with something like that..

Right now the cleanest execution I have seen and somewhat easy to run is the setup we are running. With Rekor and Downloder/viewer..
 
Joined
Nov 8, 2019
Messages
18
Reaction score
8
Location
Arizona
I resubmitted my ticket on Friday for the missing thumbnail on the Cloud Dashboard after they suggested I confirm the Agent was running....???

So now I have two tickets open for the same missing thumbnail.

But I doubt I'll hear from them since the problem got fixed with the mystery outage yesterday.....
 
Top