Date   
Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

If you have a GNU/Linux box it should also be possible to crosscompile that for Windows with mingw64-x86_64-gcc. I never did that but AFAIK that's what Hugo does with EUMETCastView.

If nothing helps ask on the google list Christian pointed to. BTW there are a couple of scripts
you could try that do not need xRITDecompress (e.g Suomi_NPP or NOAA_20 VIIRS).

When it comes to bz2 decompress I do it the GNU/Linux way but I just noted recently
that this is also provided in Python by satpy.readers.utils.unzip_file(...). So don't give up.

Cheers,
Ernst

Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Hi Hartmut,

maybe have a look here and contact Diego? He seems to solve it...?!

https://groups.google.com/d/msg/pytroll/v37T3uznBeI/hODGLbCwAgAJ

and

https://groups.google.com/d/msg/pytroll/v37T3uznBeI/Vzo9mZY6DwAJ

Regards,

Christian

Am 17.04.19 um 18:30 schrieb Hartmut Schulla:

Hi!

I give up. It’s not possible for me to compile xRITDecompress under windows because the make files are written for Linux bash.

There are so many objectswith dependencies to be separate compiled and linked together.

In Ubuntu compile and link runs smooth, butI dont’t want to setup another PC with Ubuntu.

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Ernst Lobsiger
Gesendet: Dienstag, 16. April 2019 10:42
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hartmut,

there is one point I noticed in the Makefile. Compilation defaults to 32 bits for Windows.
It can and will change to 64 bits for Linux or SunOS automatically. The Makefile dates from
2011, maybe we had no 64bit versions of Windows or Cygwin at that time? Perhaps you
should etdit that for your system and give BITS=64 a try ...

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi!

I give up. It’s not possible for me to compile xRITDecompress under windows because the make files are written for Linux bash.

There are so many objectswith dependencies to be separate compiled and linked together.

In Ubuntu compile and link runs smooth, butI dont’t want to setup another PC with Ubuntu.

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Ernst Lobsiger
Gesendet: Dienstag, 16. April 2019 10:42
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hartmut,

there is one point I noticed in the Makefile. Compilation defaults to 32 bits for Windows.
It can and will change to 64 bits for Linux or SunOS automatically. The Makefile dates from
2011, maybe we had no 64bit versions of Windows or Cygwin at that time? Perhaps you
should etdit that for your system and give BITS=64 a try ...

Regards
Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hi All

Simon has fixed the Electro-L (GOMS2) satpy reader. I have put up a new version of my scripts on Terra with the now working goms2.py satpy script. I also put a couple of Electro_L images from yesterday on Terra. IP still the same ...

Cheers,
Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

there is one point I noticed in the Makefile. Compilation defaults to 32 bits for Windows.
It can and will change to 64 bits for Linux or SunOS automatically. The Makefile dates from
2011, maybe we had no 64bit versions of Windows or Cygwin at that time? Perhaps you
should etdit that for your system and give BITS=64 a try ...

Regards
Ernst

Re: New version EUMETCastView 1.4.6

Roby
 
Edited

Many thanks, as always everything works perfectly.
But maybe I have a problem with AVHHR image settings:
in globe view, after selecting a segment (metop or noaa) and going to "Make Image" I find myself as a preview always a completely red image. Then if I select a channel (1-5) then it returns to normal.

regards
Roberto

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi!
Yes, ld not g++ produces the errors. None of external references are resolved.
Link again Windows DLLs will be the solution.
Regards



On Mon, Apr 15, 2019 at 8:14 PM +0200, "Ernst Lobsiger" <ernst.lobsiger@...> wrote:

Hartmut,

Sorry, I just know that CygWin exists :-). It seems there is a problem with linking your object code. Here is some info from the Cygwin FAQ. Hugo is the mingw specialist (used for EUMETCastView) . Maybe Simon has a solution too

Ernst


 

How do I compile a Win32 executable that doesn't use Cygwin?

 

The compilers provided by the mingw64-i686-gcc and mingw64-x86_64-gcc packages link against standard Microsoft DLLs instead of Cygwin. This is desirable for native Windows programs that don't need a UNIX emulation layer.

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

Sorry, I just know that CygWin exists :-). It seems there is a problem with linking your object code. Here is some info from the Cygwin FAQ. Hugo is the mingw specialist (used for EUMETCastView) . Maybe Simon has a solution too

Ernst


 

How do I compile a Win32 executable that doesn't use Cygwin?

 

The compilers provided by the mingw64-i686-gcc and mingw64-x86_64-gcc packages link against standard Microsoft DLLs instead of Cygwin. This is desirable for native Windows programs that don't need a UNIX emulation layer.

New version EUMETCastView 1.4.6

Hugo
 

Hello group,

I uploaded a new version of EUMETCastView 1.4.6. This version supports the new Metop-C images.
You can download it at https://github.com/hvanruys/EUMETCastView/releases
Kind regards,

Hugo

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi!

I tried CYGWin 64bit but it seems xRITDecompress ist not compatible with 64bit windows environment.

g++ says

/usr/lib/gcc/x86_64-pc-cygwin/7.4.0/../../../../x86_64-pc-cygwin/bin/ld: i386-Architektur der Eingabedatei »xRITDecompress.o« ist inkompatibel zur Ausgabe i386:x86-64“

Regards

Hartmut

 

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Ernst Lobsiger
Gesendet: Montag, 15. April 2019 14:59
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hartmut,

https://www.eumetsat.int/website/home/Data/DataDelivery/SupportSoftwareandTools/index.html

has some more info. You will probably go with CygWin.

Ernst

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Yes, I see!

Thanks!

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Ernst Lobsiger
Gesendet: Montag, 15. April 2019 14:59
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hartmut,

https://www.eumetsat.int/website/home/Data/DataDelivery/SupportSoftwareandTools/index.html

has some more info. You will probably go with CygWin.

Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

https://www.eumetsat.int/website/home/Data/DataDelivery/SupportSoftwareandTools/index.html

has some more info. You will probably go with CygWin.

Ernst

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hartmut,

as described in the HOWTO. The source code is available from EUMETSAT. It is free of charge but must be licensed on an individual basis. You will get a zip File with some instructions inside. You will also need a C-Compiler like gcc.

Ernst

The source code for the wavelet decompression program "xRITDecompress"
is available at http://oiswww.eumetsat.int/WEBOPS-cgi/wavelet/register
You must license and build the software if you do not have it already.

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi!

There is a small problem:  What’s the meaning for „xRIT decompression binary“ ?

Where to find and is there some „HowTo“ for Windows?

 

Regards

Hartmut

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Simon,

FY-4 sounds excellent. Not sure we will see that very soon on EUMETCast though. Once a reader (and the data) is available it's almost childs play to produce nice composites and projections with Pytroll/SatPy. Interesting times...

Cheers,
Ernst

Re: Pytroll/SatPy for EUMETCast

simonproud <simon.proud@...>
 

Hi Ernst,
Thanks - but my contributions are very very small...and (I think) none are related to data sent over EUMETCAST!
Unfortunately we don't use Fengyun 2 data, so I won't be able to add a reader for that. We do use FY-4 data, however, and I hope to hire a summer student who will add that data-stream to SatPy :-)

Cheers,
Simon

On Sun, 14 Apr 2019 at 22:02, Ernst Lobsiger <ernst.lobsiger@...> wrote:
Simon,

no idea how much work this really is. But could you write a SatPy reader for the FengYun GEO satellites (FY2E and FY2G IIRC)? It's HDF5 files in EUMETCast Channel_12  (Z_SATE_C_BABJ_2019 ....HDF.gz). Or could this be sort of a student project that you are able to initiate? Thank you for the code you already gave to Pytroll. My contribution will stay on a far lower level. With my aging brain I already struggle to keep my medium C-knowlege alive ...

Best regards,
Ernst

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Solved!

Running condaprompt as admin solved the problem.

Regards

Hartmut

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Hartmut Schulla
Gesendet: Montag, 15. April 2019 08:36
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Hi folks!

I’m trying miniconda for windows.

I cannt get satpy/pytroll because ssl-support is unavailable in miniconda:

 

(pytroll) C:\Users\Hartmut>conda install satpy

Collecting package metadata: failed

 

CondaHTTPError: HTTP 000 CONNECTION FAILED for url <https://repo.anaconda.com/pkgs/main/noarch/repodata.json.bz2>

Elapsed: -

 

An HTTP error occurred when trying to retrieve this URL.

HTTP errors are often intermittent, and a simple retry will get you on your way.

 

If your current network has https://www.anaconda.com blocked, please file

a support request with your network engineering team.

 

SSLError(MaxRetryError('HTTPSConnectionPool(host=\'repo.anaconda.com\', port=443): Max retries exceeded with url: /pkgs/main/noarch/repodata.json.bz2 (Caused by SSLError("Can\'t connect to HTTPS URL because the SSL module is not available."))'))

 

Can anyybody help me?

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Christian Peters via Groups.Io
Gesendet: Sonntag, 14. April 2019 22:03
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,

I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!

Simon

 

 

On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:

Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian

Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

 

 

Re: Pytroll/SatPy for EUMETCast

Hartmut Schulla
 

Hi folks!

I’m trying miniconda for windows.

I cannt get satpy/pytroll because ssl-support is unavailable in miniconda:

 

(pytroll) C:\Users\Hartmut>conda install satpy

Collecting package metadata: failed

 

CondaHTTPError: HTTP 000 CONNECTION FAILED for url <https://repo.anaconda.com/pkgs/main/noarch/repodata.json.bz2>

Elapsed: -

 

An HTTP error occurred when trying to retrieve this URL.

HTTP errors are often intermittent, and a simple retry will get you on your way.

 

If your current network has https://www.anaconda.com blocked, please file

a support request with your network engineering team.

 

SSLError(MaxRetryError('HTTPSConnectionPool(host=\'repo.anaconda.com\', port=443): Max retries exceeded with url: /pkgs/main/noarch/repodata.json.bz2 (Caused by SSLError("Can\'t connect to HTTPS URL because the SSL module is not available."))'))

 

Can anyybody help me?

 

Von: MSG-1@groups.io [mailto:MSG-1@groups.io] Im Auftrag von Christian Peters via Groups.Io
Gesendet: Sonntag, 14. April 2019 22:03
An: MSG-1@groups.io
Betreff: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,

I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!

Simon

 

 

On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:

Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian

Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:

Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.

 

 

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Simon,

no idea how much work this really is. But could you write a SatPy reader for the FengYun GEO satellites (FY2E and FY2G IIRC)? It's HDF5 files in EUMETCast Channel_12  (Z_SATE_C_BABJ_2019 ....HDF.gz). Or could this be sort of a student project that you are able to initiate? Thank you for the code you already gave to Pytroll. My contribution will stay on a far lower level. With my aging brain I already struggle to keep my medium C-knowlege alive ...

Best regards,
Ernst

Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Simon,

that's cool! I read about some problems in the past....but that's really good news!
Another cause to dive into PyTroll...! ;-)

Regards,

Christian

Am 14.04.19 um 21:57 schrieb simonproud:

Hi Christian,
I run (and develop) SatPy on a windows machine, it works without any problems or modifications compared to Linux. Just install Miniconda and away you go!
Simon


On Sun, 14 Apr 2019 at 20:54, Christian Peters via Groups.Io <hctpeters=yahoo.com@groups.io> wrote:
Ernst,

really a great overview about the possibilities we have with PyTroll/Python
to process data received by EUMETCAST. The detailed installation instructions and the
scripts are very helpful to dive into the magic of "make it by yourself" and helps a lot, as the
documentation of PyTroll lacks some more code examples. It is really amazing that you can
have nice composites with a few lines of code! Really highly integrated stuff!

Thank you very much for your efforts, maybe someone will now try PyTroll under Windows or Mac OS?
But I think the 'best' platform could be Linux as it's developed on...
Maybe worth a try to install Linux for the first time...? ;-)

Regards,

Christian


Am 13.04.19 um 10:28 schrieb Ernst Lobsiger:
Dear All,

I'am back with PyTroll/SatPy for EUMETCast. Python is going to version 3.7+ next year
and all support for Python 2.7 will end on January 1st 2020. I have now (re-)written my
HOWTO using Python 3.7.3 on a Debian 10 (Buster, still testing) GNU/Linux box. I attach
this HOWTO and a couple of PyTroll/SatPy scripts that produce high quality images. It
must be noted that these scripts should run with little adaptions under Windows with
Anaconda3 and PyTroll/SatPy installed. This means that installation method 3 described
in my HOWTO can be used on Windows or Mc OS boxes as well. One thing I'd like to stress
is that PyTroll/SatPy has projection library Proj under the hood. So it is rather easy
to reproject data moving your station or any other point of interest into the center of
the picture. With Proj more or less any map projection you can think of is included.

I now wrote a number of scripts for polar orbiting satellites as well. If you get
data from Metop_A/B/C, Suomi_NPP, NOAA-20 or EOS-Aqua/Terra each of these satellites
will produce one usable pass near or over your station every day and night. My scripts
will automatically pick up the right files to produce images of your "personal" pass.

I have put a couple of images that can be produced on my GNU/Linux receiver Terra.

Terra can be reached here:  http://185.74.120.175:85/Pictures

PyTroll/SatPy is now slowly becomming mature and the documentation has been improved
as well. We witness the grow up of a very professional software tool that is already
used by many universities and national met offices 24/7. Those who are willing to read
the documentation and climb some learning curve can be part of the development. This
is all FOSS and the small team of core developers is responsive and willing to help.


Cheers,
Ernst

P.S. As my text files were written under GNU/Linux Windows users might miss CRs at the
end of lines. If this is the case open the files with WordPad and (re-)save them again.
And *YES* I'm still a Python dummy. Don't compare my code with what people like Simon do.