Re: Problem with wspr-server ??

Rob Robinett

The WD clients independently upload spots to two servers:

1) 'Classic spots' (like those from WSJT-x) are sent directly to
2) 'Enhanced spots'  (the same spots with additional information) to

The WD client caches both sets of spots in the non-volatile directory tree ~/wsprdaemon/uploads.d/..... until the destination server acknowledges successfully receiving those spots.  WD limits upload transactions to at most 1000 spots, so after an extended outage it can take minutes or hours for all of the spots in the WD cache to be uploaded to the server.

There is a diagram of that data flow at:

Since Nov 20th Jim's 'top spotters' site has obtained its spots from the scrape.
Phil's site and Peter's WsprWatch IOS app also use the scrape.


The WD server scrapes the database 3 times during each 2 minute wspr cycle. Occasional timeouts are common, but in the last 24 hours the scraper has been frequently reporting multiple consecutive timeouts.  The WD scraper reports missing sequence numbers ('gaps') in those spot reports, but in spite of all the timeouts I see relatively few large gaps in the spot sequence numbers once they are finally delivered.

However, neither the WD client nor the WD scraper can verify if the database is dropping the spots it acknowledges that it has received.  It is on my TODO list to add a 'VALIDATE' option to the WD client's functions.  Until then, I know of nowhere to learn if has accepted but then invisibly dropped the spots being uploaded.  I can think of no way for the WD scraper to more fully validate the spot data it receives from its API call to the server.


On Sun, Dec 20, 2020 at 9:22 AM ON5KQ <ON5KQ@...> wrote:
Hi Gwyn,
Does WA2ZKD's list reflect the spots in the site, or does it show wsprdaemon database ?

New spots are showing up now again on the WA2ZKD site as well as on Phil's website wsprd.vk7jj

However where are the older spots from today - only 9000 spots showed up so far - it should be about 20000 instead at this time... Are these spots stored somewhere or lost ?
The reason,  why I want to know is, that I do not know, what to monitor is such a case as today. Perhaps I should have taken action, as there is something wrong here with my PC ?
- I know, decoder worked ok
- I know in the afternoon all decodes where stored in many files waiting to be accepted as uploaded. However it doesn't happen. Instead at a certain point all files with old spots from today disappeared and never showed up again... at least not on WA2ZLD site as well as VK7JJ's site.

There is a gap with no spots from 8h28utc to 16h46 utc. with no spots in between, which explains only 9000 spots so far... Does it mean both websites are not showing wsprdeamon database but, which is faulty ?
Unfortunately I do not understand the data flow.... hope to learn it sometimes...hi

Ulli, ON5KQ

Rob Robinett
mobile: +1 650 218 8896

Join to automatically receive all group messages.