Date   

Re: Dropping spots.

Stefan HB9TMC
 

Thank you Rob, it seems to be uploading again after moving the cache.

73
Stefan


Re: Dropping spots.

Rob Robinett
 

Since this morning's WD Users Zoom we uncovered one bug in WD spot uploading which is the result of the wsprnet.org overload problems.
I think I can implement and check in a fix before tomorrow morning.
But until then, you should be able to resume uploads of new spots by:
1) stop WD: '~/wsprdaemon/wsprdaemon.sh -z'
2) save away your current cache of spots:  'mv ~/wsprdaemon/uploads.d/wsprnet.d/ ~/wsprdaemon/uploads.d/wsprnet.d.save/'
3) start WD:   '~/wsprdaemon/wsprdaemon.sh -a'

My updated version of WD will allow you to restore and upload those saved spots/


On Wed, Dec 23, 2020 at 12:40 AM <rob@...> wrote:
Ulli,

Mine has failed completely too.

I see 1545 lines in "upload_spots_file_list.txt" and "uploads.log" has grown to 2601 lines with "broken Pipe" and "line 3420: echo: write error: Broken pipe".

No doubt this is caused by the Wsprnet issues but I suspect I will need to delete some spot   files and restart Wsprdaemon to get things started again.  Rob, do you agree?

Regards,

       Rob



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


Re: Upload to Wsprnet.org working from ON5KQ ?

Stefan HB9TMC
 

At least in my case the spots are not uploaded:

curl: (28) Operation timed out after 300000 milliseconds with 0 bytes received


73
Stefan


Re: Dropping spots.

Stefan HB9TMC
 

Since yesterday morning, no more spots are uploaded from me as well. (My spots on 2200m/630m/160m are from WSJT-X)

But other WD users seem to be able to upload fine? For example OE9GHV, KD2OM, ...


73
Stefan


Re: Upload to Wsprnet.org working from ON5KQ ?

ON5KQ
 

Rob, just for info
I confirm, that I upload the spots correctly to wsprnet.org - so the reason why there are no spots visible at Phil's site (wsprd.vk7jj) is NOT because there is nothing uploaded...
Your way to increase verbosity and watch the logs in the relevant directory makes this very clear.

So - let's just wait, until the problem will be solved at the wsprnet.org site...

Merry X-mas to all of you

Ulli, ON5KQ


Re: Dropping spots.

Rolf Ekstrand
 

I have no pending uploads here just now.  For what it is worth I observed a time gap on VK7JJ last night   from 18:12 to 18:20  ( that is 00:12 to 00:20 Z) but wspr.net  had no such gap. 

73

Rolf



 


Re: Dropping spots.

G7ELK
 

Ulli,

Mine has failed completely too.

I see 1545 lines in "upload_spots_file_list.txt" and "uploads.log" has grown to 2601 lines with "broken Pipe" and "line 3420: echo: write error: Broken pipe".

No doubt this is caused by the Wsprnet issues but I suspect I will need to delete some spot   files and restart Wsprdaemon to get things started again.  Rob, do you agree?

Regards,

       Rob


Re: Dropping spots.

Rob Robinett
 

I have been told these lost spots are due to overloads at wsprnet.org and that is under investigation.

On Tue, Dec 22, 2020 at 10:57 PM ON5KQ <ON5KQ@...> wrote:
No spots at all from my kiwis...for the last day or so...
However all received at wsprdaemon servers, I think...

So I leave everything running here and just wait...

Just strange idea:  Could it be one of the users computer, being hacked and then this infected computer is overwhelming the wsprnet.org site ot make it overload by constantly polling ? The user of the infected computer has (of coarse) no idea about the problem...
In that case the only way is to block the ip-adres of the infected users computer...
However: I just checked my PC.... so don't block me any longer at wsprnet.org..... hihi...

Ulli, ON5KQ



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


Re: Dropping spots.

ON5KQ
 

No spots at all from my kiwis...for the last day or so...
However all received at wsprdaemon servers, I think...

So I leave everything running here and just wait...

Just strange idea:  Could it be one of the users computer, being hacked and then this infected computer is overwhelming the wsprnet.org site ot make it overload by constantly polling ? The user of the infected computer has (of coarse) no idea about the problem...
In that case the only way is to block the ip-adres of the infected users computer...
However: I just checked my PC.... so don't block me any longer at wsprnet.org..... hihi...

Ulli, ON5KQ


Re: Dropping spots.

Rob Robinett
 

Thanks Rolf,

wsprnet.org is overloaded and we are trying to debug the interface between it and the wsprdaemon.org server.

Rob


On Tue, Dec 22, 2020 at 4:25 PM Rolf Ekstrand <rekstrand@...> wrote:
Now it looks OK for the last 2 hours.   At least no time gaps in reporting. 

Rolf



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


Re: Dropping spots.

Rolf Ekstrand
 

Now it looks OK for the last 2 hours.   At least no time gaps in reporting. 

Rolf


Dropping spots.

Rolf Ekstrand
 

Have observed that VK7JJ is dropping spots. Just found 10 minutes  missing whereas they are OK on WSPRnet. 
I suspect that there are more to this, but have not had time to dive into it.   It appears that jimlill.com  is  also affected.

73 Rolf  K9DZT


Re: To Proxy or not to Proxy?

G7ELK
 

Thanks for explaining Rob.


Local Monitoring

G7ELK
 

The recent Wsprnet issues have coincided with me moving to using Wsprdaemon.  I hope it wasn't me....

Good morning All,

As a result of the recent Wsprnet  disruption, it has been quite difficult to see if my new Wsprdaemon setup has been working properly - and of course I have repeatedly jumped to the conclusion that there is some kind of issue at my end, leading to lots of fiddling with settings and multiple unnecessary reboots of both the Pi and the Kiwisdr.  

I now know how to look at the Wsprdaemon upload files to see what is going on, but it would be nice to have a continuous output of spots to a console or something to provide some reassurance that all is ok.  I guess I could dig into my 25 year out of date Unix knowledge and try and do something with a script, but I'm wondering if this is something that has already been done?

Is there a Wsprdaemon command line option which I am missing which continually echos spots to the console?  Has anybody else implemented something to allow continuous local monitoring of spots?

Regards,
             Rob


Re: Problem with wspr-server ??

Stu C
 

That makes sense as it felt like wsprnet was there, but just too busy.
I do wonder why people attack that sort of site, perhaps they are doing some atmospheric heating and would rather it not show up in propagation maps.
Stu


Re: To Proxy or not to Proxy?

Rob Robinett
 

Hi Rob,

I have not implemented the proxy upload feature, so currently "proxy" is the same as "noise".  Even when it get implemented, I worry about making WD responsible for delivery of spots to wsprnet.org.  The "proxy" feature is intended for use at sites where internet connections are extremely bandwidth limited like an arctic station which uses a satellite connection.

So for now, if uploads to wsprdaemon.org are enabled you will continue to deliver spots directly to wsprnet.org.

Rob


On Mon, Dec 21, 2020 at 6:01 AM <rob@...> wrote:
All,

I am new to WsprDaemon, having only had things up and running for a couple of days.  Pretty modest station - single KiwISDR  with 8 WSPR channels into an end fed half-wave cut for 20M.  Currently I have a default setup with spots sent directly to Wsprnet, but have been wondering whether using the WsprDaemon proxy might me a better idea.  What are the pros and cons please?

I realize this might not quite be the best time to be asking this question - at various times in the last 24H the number of my spots recorded at wsprnet (when I could get in) was different and always higher than reported by WSPRD querying the Wsprdaemon database, although they seem to be coming close to being in sync again...

BTW it was a very easy automated setup on an Pi4 2GB with the latest standard Raspberry Pi OS "full fat" image.  Many Thanks for your hard work Rob!

Regards,

             Rob (G7ELK, Fareham UK)



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


Re: Problem with wspr-server ??

Rob Robinett
 

I have just learned from Gary that wsprnet.org was being subjected to DOS attacks.  

On Mon, Dec 21, 2020 at 12:54 AM ON5KQ <ON5KQ@...> wrote:
Many thanks for all the explainations... it is clear now.

So as a conclusion from the client point of view:
In any case it is best, to just keep the system running and not to try some "tweek-action" or even reboot at the client site, as soon as it is verified, that wsprd decodes correctly at the client site.

Ulli, ON5KQ

--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


To Proxy or not to Proxy?

G7ELK
 

All,

I am new to WsprDaemon, having only had things up and running for a couple of days.  Pretty modest station - single KiwISDR  with 8 WSPR channels into an end fed half-wave cut for 20M.  Currently I have a default setup with spots sent directly to Wsprnet, but have been wondering whether using the WsprDaemon proxy might me a better idea.  What are the pros and cons please?

I realize this might not quite be the best time to be asking this question - at various times in the last 24H the number of my spots recorded at wsprnet (when I could get in) was different and always higher than reported by WSPRD querying the Wsprdaemon database, although they seem to be coming close to being in sync again...

BTW it was a very easy automated setup on an Pi4 2GB with the latest standard Raspberry Pi OS "full fat" image.  Many Thanks for your hard work Rob!

Regards,

             Rob (G7ELK, Fareham UK)


Re: Problem with wspr-server ??

ON5KQ
 

Many thanks for all the explainations... it is clear now.

So as a conclusion from the client point of view:
In any case it is best, to just keep the system running and not to try some "tweek-action" or even reboot at the client site, as soon as it is verified, that wsprd decodes correctly at the client site.

Ulli, ON5KQ


Re: Problem with wspr-server ??

Rob Robinett
 

The WD clients independently upload spots to two servers:

1) 'Classic spots' (like those from WSJT-x) are sent directly to wsprnet.org
2) 'Enhanced spots'  (the same spots with additional information) to wsprdaemon.org

The WD client caches both sets of spots in the non-volatile directory tree ~/wsprdaemon/uploads.d/..... until the destination server acknowledges successfully receiving those spots.  WD limits wsprnet.org upload transactions to at most 1000 spots, so after an extended outage it can take minutes or hours for all of the spots in the WD cache to be uploaded to the wsprnet.org server.

There is a diagram of that data flow at: http://wsprdaemon.org/technical.html

Since Nov 20th Jim's jillil.com 'top spotters' site has obtained its spots from the wsprdaemon.org scrape.
Phil's wsprd.vk7jj.com site and Peter's WsprWatch IOS app also use the wsprdaemon.org scrape.

++++++++++

The WD server scrapes the wsprnet.org database 3 times during each 2 minute wspr cycle. Occasional timeouts are common, but in the last 24 hours the scraper has been frequently reporting multiple consecutive timeouts.  The WD scraper reports missing sequence numbers ('gaps') in those spot reports, but in spite of all the timeouts I see relatively few large gaps in the spot sequence numbers once they are finally delivered.

However, neither the WD client nor the WD scraper can verify if the wsprnet.org database is dropping the spots it acknowledges that it has received.  It is on my TODO list to add a 'VALIDATE' option to the WD client's wsprnet.org functions.  Until then, I know of nowhere to learn if wsprnet.org has accepted but then invisibly dropped the spots being uploaded.  I can think of no way for the WD scraper to more fully validate the spot data it receives from its API call to the wsprnet.org server.

Rob

On Sun, Dec 20, 2020 at 9:22 AM ON5KQ <ON5KQ@...> wrote:
Hi Gwyn,
Does WA2ZKD's list reflect the spots in the wsprnet.org site, or does it show wsprdaemon database ?

New spots are showing up now again on the WA2ZKD site as well as on Phil's website wsprd.vk7jj

However where are the older spots from today - only 9000 spots showed up so far - it should be about 20000 instead at this time... Are these spots stored somewhere or lost ?
The reason,  why I want to know is, that I do not know, what to monitor is such a case as today. Perhaps I should have taken action, as there is something wrong here with my PC ?
However:
- I know, decoder worked ok
- I know in the afternoon all decodes where stored in many files waiting to be accepted as uploaded. However it doesn't happen. Instead at a certain point all files with old spots from today disappeared and never showed up again... at least not on WA2ZLD site as well as VK7JJ's site.

There is a gap with no spots from 8h28utc to 16h46 utc. with no spots in between, which explains only 9000 spots so far... Does it mean both websites are not showing wsprdeamon database but wsprnet.org, which is faulty ?
Unfortunately I do not understand the data flow.... hope to learn it sometimes...hi

73s
Ulli, ON5KQ



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896

1581 - 1600 of 1670