Re: Example query and analysis using R
Gwyn Griffiths
Hello Andi
I'm glad you have found this group and the WsprDaemon database. Thank you for sharing your R example, on how to access, and on how to generate plots. I will include a link to your web page in our documentation. It would be nice to have your views on what visualisations one could program in R that would be useful but are not possible using our Grafana site. 73 Gwyn G3ZIL
|
|
Re: HELP - every day from 14h utc it is the time, when uploads are not accepted any more...
Rob Robinett
Sometimes wsprnet.org will report that it accepts only some of the uploaded spots and those spots cannot be uploaded by retrying.
It doesn't tell WD why it rejects spots or what those rejected spot are, so there is nothing more WD can do and I then delete the spot files. In contrast, uploads to wsprdaeon.org are completely under our control. To address these problems, I have suggested to Phil that he offer the option to search the extended_spots database rather than the wsprnet scrape.
|
|
Example query and analysis using R
Andi Fugard M0INF <almost@...>
Greetings,
I just found this database and group - really wonderful. Thanks all for work making it possible. Here's an example showing how to query the db using R: https://inductivestep.github.io/WSPR-analysis/ 73s, Andi M0INF
|
|
Re: HELP - every day from 14h utc it is the time, when uploads are not accepted any more...
Rob Robinett
My Maui WD is uploading to wsprnet.org without problems. So I infer your problem is unique to your site. Don't delete any of your _spots.txt, your system has space for months of spots files. Once WD can connect to wsprnet.org it will upload all of those cached spots in blocks of no more than 1000 spots. That mechanism worked in Maui and elsewhere during the Jan 1 maintenance outage. I have resumed work on the WD client and will be adding a configurable reverse proxy facility which will allow users to provide remote access without router changes.
On Sun, Jan 3, 2021 at 8:21 AM ON5KQ <ON5KQ@...> wrote: It seems to me, that the wsprnet.org website is still not under control ... --
|
|
Re: HELP - every day from 14h utc it is the time, when uploads are not accepted any more...
ON5KQ
After about 70..80min, I see now, that the curl.log shows confirmation of about 1000 spots successful uploaded.
All stored .txt files are erased on my computer.... all should be fine... HOWEVER ! Phil's website (VK7JJ) still shows a gap of 30min with no spots at all.... as I know, usually there are about 2000spots/hour at this time of the day... So 30min gap is about 1000spots missing... But why the .txt files are all erased from my computer, if wsprnet.org did not acknowledge the upload ?? I thought that after wsprd (the decoder) has generated the spots list on my computer , this list is stored in a txt file and will be only erased, if the curl-upload to wsprnet.org will be successful. If not successful, the .txt file will remain and will be only erased, if a second upload was successful... Now everything is erased, but still not uploaded ?? What has really happened ? Can I get the missing spots back somewhere to upload them ? The UN-thinkable: Does it happen that wsprnet.org acknowledge spot uploads and after that throw away half of them, if the number of uploads is too much for the site ??! Would be a real serious flaw ! Ulli, ON5KQ
|
|
HELP - every day from 14h utc it is the time, when uploads are not accepted any more...
ON5KQ
It seems to me, that the wsprnet.org website is still not under control ...
The only real problem with this is, that nobody knows, as there is no clear announcements from the system administrators, when there is any maintenance work.... However it COULD be different as well: - At 14h utc I change antenna configuration here according to the wsprdaemon.conf definition. It is one of the several times per day where changes are made with the different antennas and Kiwism switching ant directions, etc... - After WD made the changes as specified in wsprdaemon.conf the wsprnet.org website does not accept spots any more.....no spot uploads at all! Instead in of the folders: home/wsprdaemon/uploads.d/wsprnet.d/spots.d/ON5KQ_JO10os/kiwi-names/ in each kiwi-name lots of .txt files are written - every 2min a txt file... To my understanding these are the files, which are waiting for upload and which are NOT uploaded... Naturally they do not appear anywhere on VK7JJs website... Already now there are 30 files written for my spots decoded locally for the last hour, but not accepted by wsprnet,org....building up, and writing and writing .... no uploads at all! What should I do ?? In the tmp folder I can check the curl log: /tmp/wsprdaemon/uploads.d/wsprnet.d/curl.log It confirms the latest upload was accepted an hour ago.... since then nothing was uploaded... What should I do ? keep it running ?? Will it be possible to upload the spots later on ? However it will be many many many spots... Does anyone know, if wsprnet.org is 'partly out of service' ?? Is my spot rate of up to 2500 spots/hour I have seen in the past too much somewhere ? Should I disconnect a few antennas, so spot rate becomes lower ? Do I need to restart the PC and restart WD? As I said, it is difficult to know, what to do, if there is no information about, what happens at the server side... Ulli, ON5KQ Remark: Unfortunately my infrastructure here is not able to quickly allow on the fly changes so someone can log-in from outside, as other Internet services have to run permanently. I therefore cannot reconfigure routers as the routers will not store new settings without complete reboot of the system. Another bug of the hardware I found, as it fails to store settings on the fly... Time to through out such failing hardware, I know.... I am already in the process to purchase necessary replacements.
|
|
Re: AtomicPi install problem
John
Error is cleared.
Thank you Stu. TI4JWC
|
|
Re: AtomicPi install problem
Stu C
Try,
sudo apt install python3-numpy Stu
|
|
Re: AtomicPi install problem
John
Rob, "APi repo" ? Is that something you or I need to work on?
John
|
|
Re: AtomicPi install problem
Rob Robinett
yes, but it should be installed automatically by WD. Perhaps the APi repo don't have it.
I finally got a good install of Ubuntu 20.04. I removed all the unnecessary apps that leaves me with 7 G mem. --
|
|
AtomicPi install problem
John
I finally got a good install of Ubuntu 20.04. I removed all the unnecessary apps that leaves me with 7 G mem.
When installed wsprdaemon I got the error "Package python-numpy has no installation candidate. Do I need to install python-numpy ?
|
|
Feedback of unusual fault today...
ON5KQ
Happy new year to everybody...
As I was focused on family matters today, I didn't pay attention to what happened with the wsprdaemon-receivers. This afternoon however I was astonished of rather less spots than usual reported - especially 40m and up was lacking considerably. At first I thought some problem with the antenna or feed system occurred, however I found a rather unusual error message I have never seen before. I checked the file wsprdaemon/uploads.d/wsprnet.d/spots.d/uploads.log It showed the following message: ----------------------------------------------------- tr: write error: Broken pipe tr: write error: Broken pipe tr: write error /home/on5kq/wsprdaemon/wsprdaemon.sh: line 3420: echo: write error: Broken pipe ----------------------------------------------------- I stopped wsprdaemon with wsprdaemon.sh -z Note: before stopping wsprdaemon only the first line was showing in the upload.log file.... The next three lines were added after I stopped wsprdaemon Then I restarted WD again with wsprdaemon.sh -a and as result all works normal again now. However according to Phil's website there was a 90min gap, where there was no upload at all from ON5KQ Strange also, that there was nothing stored locally on my PC, not yet uploaded, but waiting for upload. I want to report it, as it might be important to help the system get more robust (wsprnet.org <--> wsprdaemon.org <--> VK7JJs site and others I have no idea where this problem came from... may be another glitch at wsprnet.org ?? Ulli, ON5KQ
|
|
Re: Ubuntu 20.04 --- no git
John
I reinstalled the Ubuntu Full version and all installed. wsprdaemon only needs me to edit the config file.
I will need to clean out all the extra apps and folders to get some space back. Thanks for the help again. john
|
|
Re: Ubuntu 20.04 --- no git
John
I had instilled the Lite version of Desktop. I will try again tomorrow with the Full version.
|
|
Re: Ubuntu 20.04 --- no git
John
Rob I tried that even with the --fix-missing switch but it still failed for some libraries.
|
|
Re: Ubuntu 20.04 --- no git
Rob Robinett
Execute “sudo apt install git”
I installed Ubuntu 20.04 on AtomicPi , added new user wsprdaemon, set the su level, but when I do the git clone https:github.com.......... --
|
|
Ubuntu 20.04 --- no git
John
I installed Ubuntu 20.04 on AtomicPi , added new user wsprdaemon, set the su level, but when I do the git clone https:github.com..........
the command I get the error git not found. Ideas for the new Ubuntu? TI4JWC
|
|
Re: Atomic Pi
John
Thank you Stu.
The common passwd root command worked well. Now I am on to my next problem: I cannot set a static IP4 address. I have used the Preference | Network connections pannels but the system does not honor my settings. I still have a DHCP assignment. I have posted this issue over on the Atomicpi forum but I am hoping there are more active users here that might know the magic required. I tried to use the root ID but I get "mesg: ttyname failed: inappropriate loctl for device". John TI4JWC
|
|
Re: Atomic Pi
Stu C
Hi John, That is specific to that board, perhaps see
https://dlidirect.com/community/champ/forums/1778-atomic-pi-user-forum/topics/4873-root-password-is-absolutely-required 73 Stu M0AQY
|
|
Atomic Pi
John
I would like to use Atomic Pi to run Wsprdaemon. I am having problems getting started.
Atonic Pi comes with Lubuntu 18.04, the current version is 20.04. I have not found any documentation for 18.04. I have been able to change the startup password. When I try to set a static IP I am asked for the Root password. I have tried the common I know. null, and Root did not work. Does anyone know the startup Root PW? John TI4JWC
|
|