Inconsistency of Grafana Noise data = gaps with no data


ON5KQ
 

Last night from 01:00h to about 03:00h UTC the Grafana page (clickhouse database, wspr.live) doesn't show any noise date
Later this night periodically the noisedata is missing for shorter periods of time...
It seems that this is happening worldwide..

Is there a problem with one of the servers, which causes the data loss ?
Or is it a similar problem like the  DoS attack we faced some weeks ago ?

What happens ?!

The problem is easily visible on wspr.live...

Ulli, ON5KQ


Gwyn Griffiths
 

Hello Ulli
The problem you describe was an unexpected transient 'side-effect' of a change to new WD 3.0 software on the server. 
Later today I will see if I can fill the missing data. 

This was not caused by an attack.

best wishes
Gwyn 


Rob Robinett
 

Hi Ulli,

In installing WD 3.0 server on WD I have uncovered a number of problems, among the most worrisome is that a couple of WD client sites (not yours) are repeatedly uploading the same valid spot+noise data files.  I am currently working on the new 3.0 code to keep it from propagating the errors generated by such repeated uploads to the WD2 server which is the source of the Grafana pages.  I will then contact those two sites to see why their WD client SW is generating such errors.

Rob

On Sat, Jan 15, 2022 at 4:11 AM Gwyn Griffiths via groups.io <gxgriffiths=virginmedia.com@groups.io> wrote:
Hello Ulli
The problem you describe was an unexpected transient 'side-effect' of a change to new WD 3.0 software on the server. 
Later today I will see if I can fill the missing data. 

This was not caused by an attack.

best wishes
Gwyn 



--
Rob Robinett
AI6VN
mobile: +1 650 218 8896


Rob Robinett
 

I have been debugging the WD 3.0 server code and despite all me pre-testing I encountered bugs which caused noise and extended spot losses on the WD2 server which feeds Grafana and wspr.live.
I believe those bugs are fixed and the noise and spots should be current now. 
Please let me know if you encounter any problems in the next few days as I finish debugging WD 3.0 on the three servers which store all the WD spot and noise as well as the clone of the wsprnet spot database used by wspr.live


ON5KQ
 

Thanks for information.
I am happy that these effects are not coming from an outside attack...
I am sorry for the additional work which it causes/caused...

regards,
Ulli