I'm looking for a pc that is economical in terms of power consumption and is still suitable for processing eumetcast data


R. Alblas
 

Graham,

You need to adapt eds.key, as explained near the download link.

And besides eds.prd you need also eds_defs.py and eds_funcs.py.

Then you can download one of the examples; only example 3 (2 files) uses xrit2pic. This example creates/updates a movie file from MSG each time it is invoked.

I am planning to make an image for RPI, probably also including satpy (which I have working now except for the magick part).

For xrit2pic I have seen that you need the right OS; I have here Ubuntu 64-bits for ARM running.

Regards,
Rob.


On 12-09-2022 16:55, g-woolf@... via groups.io wrote:

Hi Rob

I am quite interested in getting this running on a Raspberry Pi

What files do I need 
Do I need to download Eaxmples 1, 2 and 3 and the files eds_key eds_prd etc etc

Presumably I need xrit2pic for linux as well

Do you have a Raspberry Pi image to do all this

Regards

Graham


g-woolf@sky.com
 

Hi Rob

I am quite interested in getting this running on a Raspberry Pi

What files do I need 
Do I need to download Eaxmples 1, 2 and 3 and the files eds_key eds_prd etc etc

Presumably I need xrit2pic for linux as well

Do you have a Raspberry Pi image to do all this

Regards

Graham


Douglas Deans
 

No, I don't support the Native format.
Your solution fits with my thinking of using Internet downloads rather than
satellite reception.  Does it include the "foreign" satellites yet?  I hope
that EUMETSAT will include those if it does not already.
Cheers,
David
=======================================================================================

Agreed David. My Eumetcast signal is very slowly dying a death due to large trees which belong to the council. The current fiscal situation means that there is absolutely no possibility of any work ever being done on them.
I expect the basic service has a while to go yet but internet downloadable HVS-1 (and future HVS options) data would be useful.
So despite my advancing age, winter has become my favourite time of the year again !!
Will keep an eye on announcements.

Regards,
Douglas.


Michael Mehle
 

Hi David, hi Rob,

that’s a cool gadget. I will give this a try, before installing the PyTroll thing from Ernst under Debin.

Best wishes,
Michael


Am 08.09.2022 um 11:30 schrieb R. Alblas <sat@...>:


On 08-09-2022 11:08, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io wrote:
On 08/09/2022 09:18, R. Alblas wrote:
It's also possible to download the same information of data from
Eumetsat as is broadcasted with Eumetcast. E.g. MSG data, with all 12
channels, so you can combine them the same way as with data of
Eumetcast. It is in native format; I don't know if David's software of
EumetcastView supports that, but xrit2pic does.

No, I don't support the Native format.

Your solution fits with my thinking of using Internet downloads rather than
satellite reception.  Does it include the "foreign" satellites yet?  I hope
that EUMETSAT will include those if it does not already.

I don't see foreign data yet. I see METOP, MSG, RSS and IODC and some preprocessed data (e.g. airmass) for these sats. But maybe some foreign sats are at different locations.

Rob.



Cheers,
David
-- 
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv









R. Alblas
 

On 08-09-2022 11:08, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io wrote:
On 08/09/2022 09:18, R. Alblas wrote:
It's also possible to download the same information of data from
Eumetsat as is broadcasted with Eumetcast. E.g. MSG data, with all 12
channels, so you can combine them the same way as with data of
Eumetcast. It is in native format; I don't know if David's software of
EumetcastView supports that, but xrit2pic does.
No, I don't support the Native format.

Your solution fits with my thinking of using Internet downloads rather than
satellite reception.  Does it include the "foreign" satellites yet?  I hope
that EUMETSAT will include those if it does not already.
I don't see foreign data yet. I see METOP, MSG, RSS and IODC and some preprocessed data (e.g. airmass) for these sats. But maybe some foreign sats are at different locations.

Rob.



Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv





David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 08/09/2022 09:18, R. Alblas wrote:
It's also possible to download the same information of data from
Eumetsat as is broadcasted with Eumetcast. E.g. MSG data, with all 12
channels, so you can combine them the same way as with data of
Eumetcast. It is in native format; I don't know if David's software of
EumetcastView supports that, but xrit2pic does.
No, I don't support the Native format.

Your solution fits with my thinking of using Internet downloads rather than
satellite reception. Does it include the "foreign" satellites yet? I hope
that EUMETSAT will include those if it does not already.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


R. Alblas
 

It's also possible to download the same information of data from Eumetsat as is broadcasted with Eumetcast. E.g. MSG data, with all 12 channels, so you can combine them the same way as with data of Eumetcast. It is in native format; I don't know if David's software of EumetcastView supports that, but xrit2pic does.

I have here a headless RPI running continuously, collecting MSG data via internet, creating a "movie-of-the-day" and throwing away used data. Without manual intervention. I just have to copy the movie-so-far to another PC to view it. Software is mainly Python, but I use xrit2pic to create the movie (should also be possible to do with Python).

Very low energy, something like 5W.

For scripts have a look at:

http://www.alblas.demon.nl/wsat/software/eds.html

It is a simple solution, and may be done  with an image which you just have to put on a SD card for your Pi. The only thing is then asking Eumetsat for a username/password which you have to add in a file, that's all to get the thing running.

Cheers,

Rob.

On 07-09-2022 17:18, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io wrote:
On 07/09/2022 14:55, Michael Mehle via groups.io wrote:
Hi Ernst,

thanks for your information. Yes indeed, my wish was to download an image and
nearly start receiving EUMETCAST data and processing with PyTroll.
[]
Best wishes,
Michael
Michael,

Do be aware that EUMETSAT have started offering data download services over the
Internet, with no EUMETCast required.  These range from simple pre-processed
standard colour images to ones where you can write processing scripts and have
them run at EUMETSAT.  I think you should also be able to download the raw data
for your own Pytroll processing.

I think it may be worthwhile looking at these services before getting an
expensive PC and large dish to receive the full-blast data stream with much
data which you may not need.

- EUMETSAT Data Store
  https://www.eumetsat.int/eumetsat-data-store

- EUMETSAT Data Tailor
  https://www.eumetsat.int/data-tailor

- EUMDAC - Python Client for EUMETSAT Data Access Services
  https://eumetsatspace.atlassian.net/wiki/spaces/EUMDAC/overview

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv





David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 07/09/2022 14:55, Michael Mehle via groups.io wrote:
Hi Ernst,

thanks for your information. Yes indeed, my wish was to download an image and
nearly start receiving EUMETCAST data and processing with PyTroll.
[]
Best wishes,
Michael
Michael,

Do be aware that EUMETSAT have started offering data download services over the
Internet, with no EUMETCast required. These range from simple pre-processed
standard colour images to ones where you can write processing scripts and have
them run at EUMETSAT. I think you should also be able to download the raw data
for your own Pytroll processing.

I think it may be worthwhile looking at these services before getting an
expensive PC and large dish to receive the full-blast data stream with much
data which you may not need.

- EUMETSAT Data Store
https://www.eumetsat.int/eumetsat-data-store

- EUMETSAT Data Tailor
https://www.eumetsat.int/data-tailor

- EUMDAC - Python Client for EUMETSAT Data Access Services
https://eumetsatspace.atlassian.net/wiki/spaces/EUMDAC/overview

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Andreas Mueller
 

Michael,

>I am running a Raspberry Pi to receive and convert analog NOAA and METEOR Data. https://github.com/jekhokie/raspberry-noaa-v2 Easy setup and stable receiving/processing.
>My hope was that there are similar solutions for EUMETCAST.
I did (and are still running) a NOAA Pi receiving station with a complete set of own developed receiving + processing (e.g. imagick) scripts as well. From my experience running Tellicast+PyTroll on Linux requires at minimum the same level of 'making your hands dirty'. As stated earlier starting with a plain Debian + using Ernst's 'Tellicast Linux Cookbook' - this can be found somewhere here - would be a good starting point.

Andreas


Ernst Lobsiger
 

On Wed, Sep 7, 2022 at 06:55 AM, Michael Mehle wrote:
Hi Ernst,
 
thanks for your information. Yes indeed, my wish was to download an image and nearly start receiving EUMETCAST data and processing with PyTroll.
Michael,

that's probably mostly wishful thinking. Already to get a TC receiver running under GNU/Linux is not child's play. And EUMETSAT is further on the move:

https://www.eumetsat.int/eumetcast-europe-service-transponder-migration

The only way I have used to clone a full system is Clonezilla. I could image the system and home partitions of one of my receiver/processor PCs and put the
image on a ssh server accessible over the internet. A user would be expected to clone to a HDD of 500MB - 1TB. But then the user should still be capable
of adding a 2 -6TB data segment HDD and mount it on /srv. Needless to say that the system would expect a TBS-6909X and that the user sooner or later
would have to use git and gcc anyway to compile TBS drivers. Also I would have to write an additional detailed HOWTO describing my whole system.

To start processing with PyTROLL/Satpy there is my Starter Kit 3.0 or Rob's version. Both run also under Windows but are not exactly click and go either.

Regards,
Ernst


Michael Mehle
 

Yes, David,

that’s what I meant. Perhaps there is a programmer who is able to combine the necessary parts of PyTroll to start processing the Data.

Best wishes,
Michael



Am 07.09.2022 um 11:54 schrieb David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 via groups.io <david-taylor@...>:

On 07/09/2022 10:16, Ernst Lobsiger via groups.io wrote:
I'm not sure what you mean with "preinstalled images".
GNU/Linux comes in many flavours (= "Distributions").
You cannot go wrong if you take "Debian" that I use.
Ernst,

Likely he means one image to install Linux and have EUMETCast reception and
processing ready to go.

This is often done in e.g. Amateur Radio circles so that all the software
required (e.g. for multiple SDR programs and hardware support) is ready to run.
Typically for a Raspberry Pi requiring a 32 GB SD card to be flashed and
placed into the RPi. Easy!

Could be a popular choice!

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Michael Mehle
 

Hi Ernst,

thanks for your information. Yes indeed, my wish was to download an image and nearly start receiving EUMETCAST data and processing with PyTroll.

I am running a Raspberry Pi to receive and convert analog NOAA and METEOR Data. https://github.com/jekhokie/raspberry-noaa-v2 Easy setup and stable receiving/processing.

My hope was that there are similar solutions for EUMETCAST.


But thanks a lot for the Debian download link and the short „how to“. 


Best wishes,
Michael


Am 07.09.2022 um 11:16 schrieb Ernst Lobsiger via groups.io <ernst.lobsiger@...>:

Michael,

I'm not sure what you mean with "preinstalled images".
GNU/Linux comes in many flavours (= "Distributions").
You cannot go wrong if you take "Debian" that I use.

Download the  debian-11.4.0-amd64-netinst.iso  from:

https://www.debian.org/download

Burn it to a standard CD or make a bootable USB-disk.
Boot an old surplus PC and make "install" no graphics.
Install mc and get familiar with this CLI system and bash.
Running sshd you can admin that system from Windows 10
using a common ssh client program (PuTTY recommended).
If all this is rather "easy going" you are ready to move on.

Regards,
Ernst

P.S. I've answered your question re Raspberry PI further up.


David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 07/09/2022 11:32, Ernst Lobsiger via groups.io wrote:
David and Michael,

yes I know of such 'images' for the RasPI. But AFAIK there is no TC client for
the ARM processor. I suppose it could also be possible to make templates for
virtual machines. But I have never had a RasPI and have never setup a virtual
machine. One thing I could think of is to image one of my system disks with
Clonezilla and offer that via ssh over the internet.

But how should a user run and maintain a rather complex system if he never
partitioned a HDD or did an apt-get? And most GNU/Linux users want to make
their own stuff anyway.

Regards,
Ernst
Ernst,

I'm not suggesting TelliCast for the RPi, simply quoting an example of such an
image. I have used Linux images on x86 PCs in the past.

But as you say, there is a substantial amount of knowledge required to use a
Linux system, and it's an important factor in the decision of which OS to use.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Ernst Lobsiger
 

David and Michael,

yes I know of such 'images' for the RasPI. But AFAIK there is no TC client for the ARM processor. I suppose it could also be possible to make templates for virtual machines. But I have never had a RasPI and have never setup a virtual machine. One thing I could think of is to image one of my system disks with Clonezilla and offer that via ssh over the internet.

But how should a user run and maintain a rather complex system if he never partitioned a HDD or did an apt-get? And most GNU/Linux users want to make their own stuff anyway.

Regards,
Ernst


David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 07/09/2022 10:16, Ernst Lobsiger via groups.io wrote:
I'm not sure what you mean with "preinstalled images".
GNU/Linux comes in many flavours (= "Distributions").
You cannot go wrong if you take "Debian" that I use.
Ernst,

Likely he means one image to install Linux and have EUMETCast reception and
processing ready to go.

This is often done in e.g. Amateur Radio circles so that all the software
required (e.g. for multiple SDR programs and hardware support) is ready to run.
Typically for a Raspberry Pi requiring a 32 GB SD card to be flashed and
placed into the RPi. Easy!

Could be a popular choice!

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Ernst Lobsiger
 

Michael,

I'm not sure what you mean with "preinstalled images".
GNU/Linux comes in many flavours (= "Distributions").
You cannot go wrong if you take "Debian" that I use.

Download the  debian-11.4.0-amd64-netinst.iso  from:

https://www.debian.org/download

Burn it to a standard CD or make a bootable USB-disk.
Boot an old surplus PC and make "install" no graphics.
Install mc and get familiar with this CLI system and bash.
Running sshd you can admin that system from Windows 10
using a common ssh client program (PuTTY recommended).
If all this is rather "easy going" you are ready to move on.

Regards,
Ernst

P.S. I've answered your question re Raspberry PI further up.


Michael Mehle
 

Good morning Ernst,

I think about installing a complete new system based on linux, one computer for eumetcast reception, the other one for data precessing under PyTroll.

Are there existing preinstalled images? (I am no so familiar with linux at the moment. :)

Do you have an advice for the hardware of the two computers for me?

Have you heard about receiving and processing the date on two raspberry Pi's?


Thanks's for help

Best wishes,
Michael


rnosborne@...
 

Further to my previous post, I have since upgraded both my CPU and memory in anticipation of the need for more processing power with future EUMETCast services The CPU is now a Ryzen 5 5500 which has provided a noticeable improvement in overall performance. Surprisingly, the average power consumption of the PC when just receiving has dropped from about 50W to 40W. Using Satpy to decode MTG test data causes the CPU to hit 100% utilisation according to Task Manager but does not cause any packet loss. 

After installing the new CPU, I started to suffer significant packet loss at random intervals. Investigation revealed that I had fallen foul of a bug in Ryzen processors that can cause them to "stutter" and stop processing for a second or more which is disastrous when decoding a real-time data stream such as Tellicast. The bug is related to the internal Trusted Platform Module (TPM). One fix is to disable the TPM in the BIOS (a possible problem for Windows 11 users) and AMD has also provided a fix but this needs to be incorporated in the BIOS of a motherboard by an update. Follow this link for more information (AMD's Bugfix for Ryzen Stuttering Now Widely Available | Tom's Hardware (tomshardware.com)). I have applied both fixes (I don't use Windows 11) and the problem has stopped.

I did consider using an older PC as a separate receiving station. However, as this consumed significantly more mains power than the current receiving/image processing PC, I decided against it. The newer technology appears to be more power efficient.

Richard



Ernst Lobsiger
 

George,

my direction to go is to define special satpy rss (frame) areas that have
about the pixel size of my monitor. Then I encode with ffmpeg to webm.
This is not especially CPU intensive and webm runs in every current
browser with the usual controls just a right click away. Webm videos
can also easily be integrated in HTML5. Here are some MSG3 webm movies
I make on a 13 years old receiver PC with a Core2 Duo proc and 8GB RAM.
All these movies are updated every hour. Hourly full resolution GEO
and LEO images for DAY and NIG are pictured as well. Ffmpeg can also
take full size GEO images and reduce frame sizes while encoding ...

https://we.tl/t-NeYo3XsKP1

wetransfer, link active one week


Cheers,
Ernst


George Sz
 

Ernst,

A while ago I realized it's not worth making videos out of geo images. Instead, I opted to saving JPEGs (with 4:4:4 sampling) and playing them in sequence using a simple web page. This way no re-encoding is necessary, and the "movie" plays in your browser. What I did not find yet is an off-the-shelf web player that supports seeking, pause, speed change, ping-pong etc.

As an alternate, (CPU) power efficient method, I imagine it would be possible to put these JPEGs into a movie file directly, without resorting to encoding. I'm almost certain ffmpeg can take a list of pictures and put them into an M-JPEG.

Regards,
George