Date   
Re: XRIT2PIC installation problems

David J Taylor
 

Hi

Managed to get it working.
The dll files went to a different folder.

One question. How do i colorize the images as they are in black and white

Cheers ======================================

You can use:

https://www.satsignal.eu/software/geosatsignal.htm

Cheers,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv

Re: XRIT2PIC installation problems

R. Alblas
 

For geostat. satellites like MSG there are several combinations of channels implemented to colourize; see right-bottom, pop-up menu, which shows nrgb (natural rgb composite) and a lot more.
Enable 'Colours', select a satellite (not a single channel) and do Preview or Export.

Btw, there is an xrit2pic mailing list, which may be better to use for questions about xrit2pic:
https://groups.yahoo.com/neo/groups/xrit2pic/info

Rob.


On 04/01/2019 07:34 PM, Cornish Man via Groups.Io wrote:
Hi

Managed to get it working.
The dll files went to a different folder.

One question. How do i colorize the images as they are in black and white

Cheers

Reducing packet loss

David J Taylor
 

Folks,

I had a question from someone about reducing packet loss when using Windows, but I felt that my advice might be out of date, so I would appreciate input here.

- in the past disk access speed has been the major problem for the Basic Service, which has been addressed by using a RAMdisk as detailed on my Web pages. As it works, I've left that on the systems here.

- for the High Volume Service HVS-1 I've had success using a separate hard disk drive for the data, and then either using that data directly on the receiving PC, or over the network on a second processing PC.

- I'm not really using HVS-2, but on one system I wrote the data to a RAMdisk, and on another to an HDD (not carrying BAS or system activity), and this seems to work well, too. The data is immediately deleted.

- I know that Arne van Belle has a "Write and Move" solution where he has a large RAMdisk and all three services use the same write to RAMdisk, then copy completed file to HDD. I tried something similar for HVS-1/2 using Robocopy and it also worked. However that PC now uses write HVS-1 to HDD, HVS-2 to RAMdisk.

With any modern PC CPU doesn't seem to be much of an issue for reception, although I notice that some recent Windows updates have caused CPU usage by the TelliCast process to increase. What is critical is minimising disk activity as mentioned in the EUMETSAT guides by stopping anti-virus, defrag, indexing etc. just for those disks (ideally all partitions on those physical disks). SSD I recommend just for the operating system, as taking the full data load onto a single SSD may wear it out prematurely.

OK, the group would like to hear from you on your successful solutions!

Thanks,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv

Re: Reducing packet loss

Thorsten Miglus
 

Hi David,

I take BAS, HVS-1 and HVS-2 with one PC. All data is flowing to a 9 GB RAM-Disk. The data from the RAM-Disk is processed by several progams and the results are stored at a external USB HDD with 4 TB. Sentinel 3 A/B have two 2 TB internal SATA HDD's for it's own.
I observe no data losses.

Cheers,
Thorsten


On Tue, Apr 9, 2019 at 12:08 PM, David J Taylor wrote:
Folks,

I had a question from someone about reducing packet loss when using Windows, but I felt that my advice might be out of date, so I would appreciate input here.

- in the past disk access speed has been the major problem for the Basic Service, which has been addressed by using a RAMdisk as detailed on my Web pages. As it works, I've left that on the systems here.

- for the High Volume Service HVS-1 I've had success using a separate hard disk drive for the data, and then either using that data directly on the receiving PC, or over the network on a second processing PC.

- I'm not really using HVS-2, but on one system I wrote the data to a RAMdisk, and on another to an HDD (not carrying BAS or system activity), and this seems to work well, too. The data is immediately deleted.

- I know that Arne van Belle has a "Write and Move" solution where he has a large RAMdisk and all three services use the same write to RAMdisk, then copy completed file to HDD. I tried something similar for HVS-1/2 using Robocopy and it also worked. However that PC now uses write HVS-1 to HDD, HVS-2 to RAMdisk.

With any modern PC CPU doesn't seem to be much of an issue for reception, although I notice that some recent Windows updates have caused CPU usage by the TelliCast process to increase. What is critical is minimising disk activity as mentioned in the EUMETSAT guides by stopping anti-virus, defrag, indexing etc. just for those disks (ideally all partitions on those physical disks). SSD I recommend just for the operating system, as taking the full data load onto a single SSD may wear it out prematurely.

OK, the group would like to hear from you on your successful solutions!

Thanks,
David

Re: Reducing packet loss

Robert Moore
 

After teething troubles with the latest Tellicast software update I’m now running smoothly with very little data loss. On the receiver I have a 1TB SSD for OS and basic service, and a second 1TB SSD for HVS-1. No RAMdrive.

I run TrimTree to remove anything over 48 hours old in the receiver data files.

The OS/Basic disk currently holds 68 GB, the HVS-1 drive, 4 GB. So disks are almost empty. But obviously a lot of writing and reading to them – I will be interested to see how long it takes to wear them out!

 

Robert

Re: Reducing packet loss

Ernst Lobsiger
 

Dear David,

As you know I use GNU/Linux on ancient hardware with 8GB RAM only.
With these PCs I am able to receive all 3 services with good results.
Having a reasonable reception SNR is not what we are talking about.

On my PCs I had to

1) Disable all kind of C-States in the BIOS
2) Use two HDDs one for OS + locally processed images
   and one for EUMETCast Basic, HVS-1 and HVS-2 (T1 + T2) raw data
3) I used a 3.5GB RAM disk for tmp and received + my script "mvmsg"
   to move received to data HDD and to take care of damaged tmp files
4) I recently gave up the RAM disk taking care not to stress the data
   HDD (now including tmp + received) too much anymore. I do this by:
   - Omitting as far as possible du and find (re WINDOWS your trimtree
     comes to mind and of course things like defrag and virus scanners)
   - Sorting the data in a Channel/YYYY/mm/DD structure and tidy by day
   - Using the big 8000000 socket channel buffers now proposed by EUMETSAT
   - Having now most of the 8GB RAM for HDD raed/write buffering by Linux
5) A further significant step was to pin my busiest interrupts to seperate
   processor cores. For those using routers I propose to pin the NIC
   interrupt and all HDD interrupts to separate cores. It's rather easy
   under Linux (I published a script on this list recently). Maybe someone
   can come up with a similar solution and demonstrate results for WINDOWS.

I always had 2 PC systems though I still locally process all OLCI EFR data of
Sentinel-3A and Sentinel-3B on the receiver. The idea is not to move data
around too much. My receivers NFS export data for processing with PyTroll/SatPy
and EUMETCastView. Other than the receivers my processing PCs do not run 24/7.
An I make no attempt to process e.g. all GOES-16 data to make 4K animations.
I will use 4TB data HDDs in the future to get some more slack. I am convinced
that the two PC system is the future (Thorsten will object :-) route we should
take regarding the amount of data we already get and will soon get with MTGs.


Cheers,
Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

Re: Pytroll/SatPy for EUMETCast

Hugo
 

Nice write up Ernst ! Many thanks ....
grts,

Hugo


On Sat, Apr 13, 2019 at 01:28 AM, Ernst Lobsiger wrote:
http://185.74.120.175:85/Pictures

Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian


Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

Re: Pytroll/SatPy for EUMETCast

simonproud <simon.proud@...>
 

Hi Christian,
I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!
Simon


On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:
Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian


Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:
Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,
I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!
Simon


On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:
Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian


Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:
Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Simon,

no idea how much work this really is. But could you write a SatPy reader for the FengYun GEO satellites (FY2E and FY2G IIRC)? It's HDF5 files in EUMETCast Channel_12  (Z_SATE_C_BABJ_2019 ....HDF.gz). Or could this be sort of a student project that you are able to initiate? Thank you for the code you already gave to Pytroll. My contribution will stay on a far lower level. With my aging brain I already struggle to keep my medium C-knowlege alive ...

Best regards,
Ernst

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi folks!

I’m trying miniconda for windows.

I cannt get satpy/pytroll because ssl-support is unavailable in miniconda:

 

(pytroll) C:\Users\Hartmut>conda install satpy

Collecting package metadata: failed

 

CondaHTTPError: HTTP 000 CONNECTION FAILED for url <https://repo.anaconda.com/pkgs/main/noarch/repodata.json.bz2>

Elapsed: -

 

An HTTP error occurred when trying to retrieve this URL.

HTTP errors are often intermittent, and a simple retry will get you on your way.

 

If your current network has https://www.anaconda.com blocked, please file

a support request with your network engineering team.

 

SSLError(MaxRetryError('HTTPSConnectionPool(host=\'repo.anaconda.com\', port=443): Max retries exceeded with url: /pkgs/main/noarch/repodata.json.bz2 (Caused by SSLError("Can\'t connect to HTTPS URL because the SSL module is not available."))'))

 

Can anyybody help me?

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Christian Peters via Groups.Io
Gesendet: Sonntag, 14. April 2019 22:03
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,

I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!

Simon

 

 

On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:

Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian

Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

 

 

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Solved!

Running condaprompt as admin solved the problem.

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Hartmut Schulla
Gesendet: Montag, 15. April 2019 08:36
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hi folks!

I’m trying miniconda for windows.

I cannt get satpy/pytroll because ssl-support is unavailable in miniconda:

 

(pytroll) C:\Users\Hartmut>conda install satpy

Collecting package metadata: failed

 

CondaHTTPError: HTTP 000 CONNECTION FAILED for url <https://repo.anaconda.com/pkgs/main/noarch/repodata.json.bz2>

Elapsed: -

 

An HTTP error occurred when trying to retrieve this URL.

HTTP errors are often intermittent, and a simple retry will get you on your way.

 

If your current network has https://www.anaconda.com blocked, please file

a support request with your network engineering team.

 

SSLError(MaxRetryError('HTTPSConnectionPool(host=\'repo.anaconda.com\', port=443): Max retries exceeded with url: /pkgs/main/noarch/repodata.json.bz2 (Caused by SSLError("Can\'t connect to HTTPS URL because the SSL module is not available."))'))

 

Can anyybody help me?

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Christian Peters via Groups.Io
Gesendet: Sonntag, 14. April 2019 22:03
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,

I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!

Simon

 

 

On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:

Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian

Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

 

 

Re: Pytroll/SatPy for EUMETCast

simonproud <simon.proud@...>
 

Hi Ernst,
Thanks - but my contributions are very very small...and (I think) none are related to data sent over EUMETCAST!
Unfortunately we don't use Fengyun 2 data, so I won't be able to add a reader for that. We do use FY-4 data, however, and I hope to hire a summer student who will add that data-stream to SatPy :-)

Cheers,
Simon

On Sun, 14 Apr 2019 at 22:02, Ernst Lobsiger <ernst.lobsiger@...> wrote:
Simon,

no idea how much work this really is. But could you write a SatPy reader for the FengYun GEO satellites (FY2E and FY2G IIRC)? It's HDF5 files in EUMETCast Channel_12  (Z_SATE_C_BABJ_2019 ....HDF.gz). Or could this be sort of a student project that you are able to initiate? Thank you for the code you already gave to Pytroll. My contribution will stay on a far lower level. With my aging brain I already struggle to keep my medium C-knowlege alive ...

Best regards,
Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Simon,

FY-4 sounds excellent. Not sure we will see that very soon on EUMETCast though. Once a reader (and the data) is available it's almost childs play to produce nice composites and projections with Pytroll/SatPy. Interesting times...

Cheers,
Ernst

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi!

There is a small problem:  What’s the meaning for „xRIT decompression binary“ ?

Where to find and is there some „HowTo“ for Windows?

 

Regards

Hartmut

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

as described in the HOWTO. The source code is available from EUMETSAT. It is free of charge but must be licensed on an individual basis. You will get a zip File with some instructions inside. You will also need a C-Compiler like gcc.

Ernst

The source code for the wavelet decompression program "xRITDecompress"
is available at http://oiswww.eumetsat.int/WEBOPS-cgi/wavelet/register
You must license and build the software if you do not have it already.

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

https://www.eumetsat.int/website/home/Data/DataDelivery/SupportSoftwareandTools/index.html

has some more info. You will probably go with CygWin.

Ernst

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Yes, I see!

Thanks!

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Ernst Lobsiger
Gesendet: Montag, 15. April 2019 14:59
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hartmut,

https://www.eumetsat.int/website/home/Data/DataDelivery/SupportSoftwareandTools/index.html

has some more info. You will probably go with CygWin.

Ernst