Date   

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham and Ferdinand,

thanks for those performance figures. It seems I have no chance with my old machines to make a GRDH image with my own scripts :-(. I got a maximum 24GB of RAM in one 8 year old Fujitsu Celsius W520 Power WS I bought for CHF 150.-- (original price lowered because it was 2 years older than advertised) from e-Bay.de. Graham could you make the four possible composites as GRDH and put them on e.g flickr (no idea how to do that, image file limit seems to be 200MB) or a similar web service and post al link here? So others on MSG-1 can see/download the highest resolution results of A68a so far. You should mention "Copernicus Sentinel data 2020" to be consistant with the EU/ESA Copernicus  data policy.

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Ernst,

 

In order to have more complete info on time:

 

Your script runs here on Windows 10, 128 GB RAM and sar_ice selected in the script:

Medium resolution: 56”

High Resolution 2’ 21”

CPU occupation for this event up to 73%

RAM had brief moment of 55 GB used for this event but stayed mostly around 30 to 40.

 

Certainly doable but resource intensive

 

Cheers,

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of Ferdinand Valk
Sent: Friday, 11 December, 2020 08:59
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Graham,

 

The M stands for Medium resolution and the H for High.

The High works fine here on a Windows 10 w 128 GB RAM .

 

Cheers,

Ferdinand

 

From: MSG-1@groups.io On Behalf Of Graham Woolf
Sent: Friday, 11 December, 2020 08:38
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Good Morning Ernst

Im not sure - I just downloaded the two files from your site as per your instructions

Whats the difference between GRDM and GRDH

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi all

Just ran the script with the H setting

CPU peaked at about 70% for a few seconds but was generally in the low teens

Ram used peaked at about 90GB but generally around 50GB

It took 3 minutes to process

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Graham,

 

The M stands for Medium resolution and the H for High.

The High works fine here on a Windows 10 w 128 GB RAM .

 

Cheers,

Ferdinand

 

From: MSG-1@groups.io On Behalf Of Graham Woolf
Sent: Friday, 11 December, 2020 08:38
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Good Morning Ernst

Im not sure - I just downloaded the two files from your site as per your instructions

Whats the difference between GRDM and GRDH

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

You were right - I was too keen . Mind you it was late last night when I tried

I will try the 'H' file today

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

On Fri, Dec 11, 2020 at 12:37 AM, Graham Woolf wrote:
Good Morning Ernst

Im not sure - I just downloaded the two files from your site as per your instructions

Whats the difference between GRDM and GRDH

Regards

Graham
Graham,

you can check the number of pixels of the resulting image. I almost knew you would just start the script. But as distributed it will make a 4000x4000 image which is good for GRDM (see filename of *.zip) data. GRDH is higher resolution data (see size of the *.zip). You have received 2 x the same segment but as GRDM and GRDH. To make the GRDH image change in the script resolution='H' (I distributed it with resolution='M') and rerun it again. Then report your figures again.

Best regards
Ernst

P.S. The string GRDM or GRDH is also in the filename of the resulting image.


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Good Morning Ernst

Im not sure - I just downloaded the two files from your site as per your instructions

Whats the difference between GRDM and GRDH

Regards

Graham


Re: Receiving and Processing Geostationary Images

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 10/12/2020 20:34, Allan Sloan via groups.io wrote:
I have just got back into receiving weather satellites, getting my RX2 and a old laptop up and running again, have now also set up a Raspberry PI and USB dongle. This is producing very good results.
So now wanting to try Geostationary again.
Back in the day, I used a Yagi with a down convertor into my satellite receiver at the time.
So looking to see what equipment and software is required now. and what are the likely costs for this.
I have a sky dish  ( which is lying in a corner of the garden, as I now use Virgin ) and was wondering what else I would need. My location is in Irvine Scotland.
So does anyone have a good write up, or a website, to guide me on my quest.
All help and assistance greatly received.
Regards
Allan Sloan
Allan,

There would be good write-ups on previous GEO Quarterly journals, now all on the Web. My Web site may help. The 1.7 GHz service is no more.

Basically:

"Satellite TV"
- 80 cm or bigger dish
- LNB
- cable

- DVB-S2 receiver, cheapest 2nd hand TBS5925, USB out so works with a portable PC too.
- EUMETSAT software and USB dongle (free)

- Processing & display software
- free (much assembly required, Windows or Linux)
- my own MSG Toolset Plus suite (ready to go, Windows)

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: RX 2 wanted

Allan Sloan
 

David,

Thanks for the suggestion of Raspberry PI & USB dongle.

Have now had one set up and working to the references you gave me.

All working well. Cant wait until i can get some better visible images.

Thanks again.

Regards Allan


Receiving and Processing Geostationary Images

Allan Sloan
 

I have just got back into receiving weather satellites, getting my RX2 and a old laptop up and running again, have now also set up a Raspberry PI and USB dongle. This is producing very good results.

So now wanting to try Geostationary again.

Back in the day, I used a Yagi with a down convertor into my satellite receiver at the time.

So looking to see what equipment and software is required now. and what are the likely costs for this.

I have a sky dish  ( which is lying in a corner of the garden, as I now use Virgin ) and was wondering what else I would need. My location is in Irvine Scotland.

So does anyone have a good write up, or a website, to guide me on my quest.

All help and assistance greatly received.

Regards

Allan Sloan

 


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham,

I assume this is the GRDM or is it the 8000x8000 GRDH? If you can easily make GRDH
composites maybe you find a place on the NET where we can download them. There
is an EU Copernicus Data Policy also on my receiver I0. Io did take all 3 EUMETCast
services with no packet missed while a couple of users stressed apache2 with download.

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Here is a screenshot of the image

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

It took about just under 2 minutes on my PC - not more than 50%  CPU usage

It used about 40GB of the available 128GB

I have an Intel(R) Core(TM) i7-7820X CPU @ 3.60GHz   3.60 GHz

Its a lovely image too

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham and Jeskynar

I made a minimal script that you can test. No fancy stuff just the *.jpg of one segment. Should run out of the box.
I used 80m resolution (GRDM) but there is 50m resolution (GRDH)! This should pretty much fill your monster
RAMs. Gives 4000x4000 (GRDM) or 8000x8000 (GRDH) *.jpg of iceberg A68a. All is found on my receiver Io.

Good luck
Ernst

P.S. Please post results like memory usage, processing time, PC used. Do *not* post original sized *.jpg here.
Not sure how long is takes to get the *.zip files. You will also find them on the Copernicus Open Access Hub


Re: Pytroll/SatPy for EUMETCast

Hugo
 

Ernst,

WOW !

grts,

Hugo


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Beautifully done Ernst. Colouration, even when false, does add significantly to the image. My sar remains in the b&w realm.

Still a long way to go in learning to get to this level.....

 

Ferdinand

 

From: MSG-1@groups.io On Behalf Of Ernst Lobsiger via groups.io
Sent: Thursday, 10 December, 2020 15:29
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

On Thu, Dec 10, 2020 at 06:58 AM, Graham Woolf wrote:

Here is one of the Alps

Regards

Graham

Graham,

a very nice image. You don't get those very frequently. I have NEWS from A68a but these are SAR 80m resolution.
I cannot post these here and have no www site either. So I put them on my 12 years old EUEMETCast receiver Io.

See here (files are huge):

http://5.153.116.236:81

and don't ask me for my Satpy script (it uses MultiScene and other high end stuff (needs up to 24GB RAM).

Cheers,
Ernst

P.S. You now probably have 2 instances of GSHHG coast line Data Base (I think it only was a path problem).


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Lovely images

I am up for a challenge - I have 128Gb Ram in my PC

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

On Thu, Dec 10, 2020 at 06:58 AM, Graham Woolf wrote:
Here is one of the Alps

Regards

Graham
Graham,

a very nice image. You don't get those very frequently. I have NEWS from A68a but these are SAR 80m resolution.
I cannot post these here and have no www site either. So I put them on my 12 years old EUEMETCast receiver Io.

See here (files are huge):

http://5.153.116.236:81

and don't ask me for my Satpy script (it uses MultiScene and other high end stuff (needs up to 24GB RAM).

Cheers,
Ernst

P.S. You now probably have 2 instances of GSHHG coast line Data Base (I think it only was a path problem).


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Here is one of the Alps

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Just to let you know I have produced a Sentinel 3 image today using your script

Its of South Georgia but not worth posting as its mostly cloud

I had to download GSHHG files though before it would work

Thanks for the script

Regards

Graham

981 - 1000 of 31351