Date   

Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

On Mon, Dec 14, 2020 at 12:35 AM, <maurizio.calvitti@...> wrote:

Ernst,

Here is my first Himawari-8 image.

Just a suggestion:   the day-night border is too clear, could it  be smoothed (penumbra zone) like in the original B/W imagine.

 

My best regards,

Maurizio

Maurizio,

that was quick: Welcome to the Club! SatPy has certainly some enhancements built in for the penumbra zone.
But this is all up to you now. My personal interest 202012 is SAR EW. Read the latest docs on www.pytroll.org 


Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

Ernst,

Here is my first Himawari-8 image.

Just a suggestion:   the day-night border is too clear, could it  be smoothed (penumbra zone) like in the original B/W imagine.

 

My best regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 19:45
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

On Sun, Dec 13, 2020 at 08:54 AM, <maurizio.calvitti@...> wrote:

This is my first Meteosat-11 image!!!! By Pytroll/SatPy…

The adventure has begun!

Maurizio,

Congratulations (even if this is still more or less my MSG4 image)! If you come up with your first Himawari
image we will definitely welcome you in the "Old Farts Club" (as promoted by Hugo). I had a quick look
at MDM. It seems MDM expects everything in that "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2".
This means that also HVS-1 Channel E1H-TPG-1 (Himawari-8 files) will go to the same directory that you
name .../received/bas/... I'm confused to say the least. Or do you run more MDMs for HVS-1 and HVS-2?
That's *very* different from what I do. I use each EUMETCast channel with a Yea/Mon/Day data structure.

But I noted (I hope you know much better than I do), that you can setup MDM and it will do it's jobs
and move the raw data to C:\MSG-1\RawData\year\mon\day structure. You can also tell MDM to keep the
files there e.g. one to two days and then to delete these raw data. This should interface perfectly with my
Starter-Kit. You can just let MDM do its job and change the segment directory in each of my scripts to

segdir = "C:/MSG-1/RawData" + "/" + Yea + "/" + Mon + "/" + Day

And it must be exactly like that:  No more 30 posts for this line! And make sure MDM also moves the
PROLOG and EPILOG Files for all Meteosats and other GEO Satellites that need those. Maybe you have
a different path for the above, then use this one (I almost see you have a folder "IMMAGINI SATELLITI"
in your home directory?). Maybe that's the place to look? Windows 10 users should help you with MDM!

In any case it looks possible that you let MDM work (almost) as usual and still adventure into Pytroll/Satpy.

Good Luck
Ernst


P.S. Can't wait for that first Himawari image generated by Pytroll/Satpy under your Windows 10 ...


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

On Sun, Dec 13, 2020 at 08:54 AM, <maurizio.calvitti@...> wrote:

This is my first Meteosat-11 image!!!! By Pytroll/SatPy…

The adventure has begun!

Maurizio,

Congratulations (even if this is still more or less my MSG4 image)! If you come up with your first Himawari
image we will definitely welcome you in the "Old Farts Club" (as promoted by Hugo). I had a quick look
at MDM. It seems MDM expects everything in that "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2".
This means that also HVS-1 Channel E1H-TPG-1 (Himawari-8 files) will go to the same directory that you
name .../received/bas/... I'm confused to say the least. Or do you run more MDMs for HVS-1 and HVS-2?
That's *very* different from what I do. I use each EUMETCast channel with a Yea/Mon/Day data structure.

But I noted (I hope you know much better than I do), that you can setup MDM and it will do it's jobs
and move the raw data to C:\MSG-1\RawData\year\mon\day structure. You can also tell MDM to keep the
files there e.g. one to two days and then to delete these raw data. This should interface perfectly with my
Starter-Kit. You can just let MDM do its job and change the segment directory in each of my scripts to

segdir = "C:/MSG-1/RawData" + "/" + Yea + "/" + Mon + "/" + Day

And it must be exactly like that:  No more 30 posts for this line! And make sure MDM also moves the
PROLOG and EPILOG Files for all Meteosats and other GEO Satellites that need those. Maybe you have
a different path for the above, then use this one (I almost see you have a folder "IMMAGINI SATELLITI"
in your home directory?). Maybe that's the place to look? Windows 10 users should help you with MDM!

In any case it looks possible that you let MDM work (almost) as usual and still adventure into Pytroll/Satpy.

Good Luck
Ernst


P.S. Can't wait for that first Himawari image generated by Pytroll/Satpy under your Windows 10 ...


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

Ernst,

This is my first Meteosat-11 image!!!! By Pytroll/SatPy…

The adventure has begun!

 

Thanks for your help…

 

 

Maurizio

 

 

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 17:18
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,

The image is in:

imgdir = "D:/EMCdata/images/Meteosat-11"

see the script msg4.py as well as one of my many posts.

If you do not find it there you should have at least
a *.png without annotation in the temp directory

tmpdir = "D:/EMCdata/tmpdirs/xmsg4"

Regards,
Ernst

P.S. Post your first Meteosat-11 image so we can call this a day ...


Re: Iceberg A-68A from Metop.

Graham Woolf
 

Hi Ernst

Thanks - thats useful to know - I didnt appreciate that

Regards

Graham


Re: Iceberg A-68A from Metop.

Ernst Lobsiger
 

Graham,

you will not get a good image each day. Sentinel-1 has a repeat cicle of 12 days. As Sentinel-1A and Sentinel-1B
have the same orbit but 180° out of phase this makes 6 days. Every 6 days you should see South Georgia and A68
on the same image. We already had that December 3rd and December 9th. Next should be December 15th. AFAIK
Ferdinand had A68 only on an ascending path. IIRC this was December 7th. If this is correct we have such a pic today.

Regrds,
Ernst


Re: Iceberg A-68A from Metop.

Graham Woolf
 

Hi Ferdinand

Thanks - I'll have a look

Kind Regards

Graham


Re: Iceberg A-68A from Metop.

Ferdinand Valk
 

Graham,

 

One can as far as I know only use scripted downloads via http(s) and not ftp. It works the same though. The address for the script is

 

https://scihub.copernicus.eu/apihub/

 

The instructions for creating the script can be found here:

https://scihub.copernicus.eu/twiki/do/view/SciHubUserGuide/BatchScripting?redirectedfrom=SciHubUserGuide.8BatchScripting

 

Hope this helps.

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of Graham Woolf
Sent: Sunday, 13 December, 2020 16:08
To: MSG-1@groups.io
Subject: Re: [MSG-1] Iceberg A-68A from Metop.

 

Hi

Can anyone tell me if its possible to directly FTP Copernicus Sentinel 1 files from their site - I have registered on their portal but would like to run a script to ftp files each day

If so is there a link

Regards

Graham


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Maurizio,

The image is in:

imgdir = "D:/EMCdata/images/Meteosat-11"

see the script msg4.py as well as one of my many posts.

If you do not find it there you should have at least
a *.png without annotation in the temp directory

tmpdir = "D:/EMCdata/tmpdirs/xmsg4"

Regards,
Ernst

P.S. Post your first Meteosat-11 image so we can call this a day ...


Re: Iceberg A-68A from Metop.

Graham Woolf
 

Hi

Can anyone tell me if its possible to directly FTP Copernicus Sentinel 1 files from their site - I have registered on their portal but would like to run a script to ftp files each day

If so is there a link

Regards

Graham


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

Yes now I see decompression…. with processed files in the tmpdirs  directory.

 

But I don’t see any image,  in the directory images…

 

However another step forward!

 

Regards,

Maurizio

 

 

 

 

 

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 16:36
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,

I now also managed to decompress your msg4.py that you sent me as msg4.rar. And that's what I find :-( :

segdir = "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2/%YYYY%mm%DD%HH%MM"

Please edit segdir to what I have told you several times: IT MUST READ:

segdir = "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2"

and if this fails because Windows or Python does not want it that way do what we found at the prompt:

segdir = "I:/EUMETCast/received/bas/EUMETSAT_data_channel_2"

At your Anaconda prompt with environment (pytroll) activated change to C:\EMCtool\pyscripts and TYPE not EDIT:

python msg4.py 202012131200

+ press Enter (Return), sounds not that complicated to me.

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Thank's for that \\ versus / Ferdinand. I have seen it in Python code. I now need two Espressi!
As a teacher I have learnt to be patient. But I retired 2014 and as a physicist I have never been.

See you later in a SAR thread. I have some news and questions.

Best regards,
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

Ferdinand Valk
 

Ernst,

 

It is also possible to change the backslash which is particular to a Windows path to a double backslash, instead of changing it to a forward slash. Python will automatically interpret \\ to be /.

 

Ferdinand

 

From: MSG-1@groups.io On Behalf Of Ernst Lobsiger via groups.io
Sent: Sunday, 13 December, 2020 15:15
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,

Try in the script "...data_channel" lower case (Windows is not case sensitive, but UNIX has always been, GNU\Linux is and Python is as well):
The worst point is that your Windows 10 Explorer shows the path Camel Case "...Data_Channel_2". Such is Windows, ...

Ernst

Try:     segdir = "I:/EUMETCAST/received/bas/EUMETSAT_data_channel_2"

I:\EUMETCAST\received\bas\EUMETSAT_data_channel_2


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Maurizio,

I now also managed to decompress your msg4.py that you sent me as msg4.rar. And that's what I find :-( :

segdir = "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2/%YYYY%mm%DD%HH%MM"

Please edit segdir to what I have told you several times: IT MUST READ:

segdir = "I:/EUMETCast/received/bas/EUMETSAT_Data_Channel_2"

and if this fails because Windows or Python does not want it that way do what we found at the prompt:

segdir = "I:/EUMETCast/received/bas/EUMETSAT_data_channel_2"

At your Anaconda prompt with environment (pytroll) activated change to C:\EMCtool\pyscripts and TYPE not EDIT:

python msg4.py 202012131200

+ press Enter (Return), sounds not that complicated to me.

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Maurizio,

Try in the script "...data_channel" lower case (Windows is not case sensitive, but UNIX has always been, GNU\Linux is and Python is as well):
The worst point is that your Windows 10 Explorer shows the path Camel Case "...Data_Channel_2". Such is Windows, ...

Ernst

Try:     segdir = "I:/EUMETCAST/received/bas/EUMETSAT_data_channel_2"

I:\EUMETCAST\received\bas\EUMETSAT_data_channel_2


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

In tellicast ini files I see “_” underline..

 

Ciao

maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 15:42
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,

Are you sure your drive is I:\ like Irene and not l:\ like lara (no difference seen in this font)?
Are you sure you do not see any spaces  " " in the path, should all be underline "_"?
EUMETSAT's Windows channel names used to be with spaces in Telicast client.ini files?

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

Irene like  Iron…

 

You can have a look to  MY_files.txt and msg4.py

 

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 15:42
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,

Are you sure your drive is I:\ like Irene and not l:\ like lara (no difference seen in this font)?
Are you sure you do not see any spaces  " " in the path, should all be underline "_"?
EUMETSAT's Windows channel names used to be with spaces in Telicast client.ini files?

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Maurizio,

Are you sure your drive is I:\ like Irene and not l:\ like lara (no difference seen in this font)?
Are you sure you do not see any spaces  " " in the path, should all be underline "_"?
EUMETSAT's Windows channel names used to be with spaces in Telicast client.ini files?

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

Ernst Lobsiger
 

Maurizio,

I'am sure we are close. Have you tested 202012131115 too? The scripts as distributed work perfectly under Windows 10!

if the above does not work then:

Open the Anaconda3 prompt or even better a pure CMD prompt and change to Desktop  (cd Desktop  + Enter)
At the prompt .../Desktop> enter the command (and press Enter)
dir I:\EUMETCast\received\bas\EUMETSAT_Data_Channel_2\*  > My_Files.txt

This will make a list of files in My_Files.txt  (on the Desktop, you can open it with Notepad)

Attach "My_Files.txt" and your "msg4.py" to your next post on MSG-1.

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast..Help

maurizio.calvitti@...
 

Yes Ernst,

MDM  is  Meteosat Data manager by David.

Now I have stopped it for not not moving/processing and even deleting the MSG4 files

 

Unprocessed Msg4 Data files have started to flow in the folder at  11:00 UTC

Now It’s 13:18 UTC

I have almost two hs data but the results doesn’t change….

 

I have edited python msg4.py  202012131100

 

“Filenames was provided but empty”

 

I have no idea ….why! maybe some difference at system level on the language used to call files and wildcards.

 

Ciao

Maurizio

 

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: domenica 13 dicembre 2020 13:04
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast..Help

 

Maurizio,
I have no idea of MDM. Must be David's file manager? It seems you only have a limited number of files from today? I guess you had to stop MDM for not moving/processing and even deleting the MSG4 files?
You should at least have one hour of MSG files! You canot make images from files not yet received!

If so (from what I see on your screenshot), try time slots:
202012131045
202012131100
202012131115
202012131130

You can press the up key to get back your last command, then just edit the digits necessary ...

Good luck
Ernst
...

921 - 940 of 31359