Date   

Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

All,

Sentinel-3B just catched a view on the piece broken off from the blunt end of iceberg A68a. Is this piece now A68b? @Maurizio you should get this image by now!(?)

Cheers,
Ernst


Re: Eumetcastview, xrit2pic doesn't processing NOAA 20, NPP data

Giftmacher
 

Allegedly there is also lots of GOES 16 data in the folder, but can't see anything of it in both programs. Please help.


Re: AVHRR images in DWDSAT data - continued need?

john.haslam4@...
 

Hi

I do not use this data.

I get AVHRR and VIIRS from EUMETCast using David Taylor's HRPT reader to
process and display for AVHRR and Satpy for VIIRS.

Best Rgds

John

-----Original Message-----
From: MSG-1@groups.io <MSG-1@groups.io> On Behalf Of Holl Gerrit
Sent: 18 December 2020 10:45
To: MSG-1@groups.io
Subject: [MSG-1] AVHRR images in DWDSAT data - continued need?

Hello,

as part of EUMETCast, the German Weather Service (DWD) distributes some
weather data in the DWDSAT Service [1]. This service includes weather maps,
meteograms, and text forecasts, among other things. It also includes AVHRR
single-channel images and a SEVIRI HRV day/night composite for three areas
over Europe, Central Europe, and Germany, such as the attached example over
Central Europe.

At DWD we are updating our satellite processing software, including the
software used to produce the PNG images from AVHRR and distributed via
DWDSAT. I would like to know if there is a continued need for those images,
and if it would be a problem to stop their broadcast in DWDSAT. EUMETCAST
users already have access to AVHRR data as part of EARS, and I am not sure
what the added value of the AVHRR images in DWDSAT would be. This broadcast
was started a long time ago under my predecessor. Users needing PNG can
quite easily produce single-channel images themselves using open-source
software such as Pytroll[2]/Satpy[3] (which is the software we are
transitioning to ourselves for AVHRR processing), and the SEVIRI VIS/HRV
combination is not too hard to set up either (I think we're already
producing this with Satpy).

Is anyone still using AVHRR data from DWDSAT? If yes, is there a continued
need? What is the added value or advantage compared to data available in
EARS?

best regards,
Gerrit Holl,
German Weather Service, Remote Sensing Application Development Division.

P.S. I saw references to a dedicated group for DWDSAT users, but I could not
find a corresponding group after the migration to groups.io; I apologise if
I missed it and if this is the wrong forum for this query.

[1] https://navigator.eumetsat.int/product/EO:EUM:DAT:MODEL:DWDSAT
[2] http://pytroll.github.io/
[3] https://satpy.readthedocs.io/en/stable/
[4] https://groups.io/g/MSG-1/message/3289

--
Gerrit Holl
Deutscher Wetterdienst, division FE23
+49 (69) 8062-3171


Re: AVHRR images in DWDSAT data — continued need?

Daniele Guardigli
 

Hello,

I'm almost new to this...where can i get ddwdsat data? 

Il Ven 18 Dic 2020, 12:40 Holl Gerrit <gerrit.holl@...> ha scritto:
Hello,

as part of EUMETCast, the German Weather Service (DWD) distributes some weather data in the DWDSAT Service [1].  This service includes weather maps, meteograms, and text forecasts, among other things.  It also includes AVHRR single-channel images and a SEVIRI HRV day/night composite for three areas over Europe, Central Europe, and Germany, such as the attached example over Central Europe.

At DWD we are updating our satellite processing software, including the software used to produce the PNG images from AVHRR and distributed via DWDSAT.  I would like to know if there is a continued need for those images, and if it would be a problem to stop their broadcast in DWDSAT.  EUMETCAST users already have access to AVHRR data as part of EARS, and I am not sure what the added value of the AVHRR images in DWDSAT would be.  This broadcast was started a long time ago under my predecessor.  Users needing PNG can quite easily produce single-channel images themselves using open-source software such as Pytroll[2]/Satpy[3] (which is the software we are transitioning to ourselves for AVHRR processing), and the SEVIRI VIS/HRV combination is not too hard to set up either (I think we're already producing this with Satpy).

Is anyone still using AVHRR data from DWDSAT?  If yes, is there a continued need?  What is the added value or advantage compared to data available in EARS?

best regards,
Gerrit Holl,
German Weather Service, Remote Sensing Application Development Division.

P.S. I saw references to a dedicated group for DWDSAT users, but I could not find a corresponding group after the migration to groups.io; I apologise if I missed it and if this is the wrong forum for this query.

[1] https://navigator.eumetsat.int/product/EO:EUM:DAT:MODEL:DWDSAT
[2] http://pytroll.github.io/
[3] https://satpy.readthedocs.io/en/stable/
[4] https://groups.io/g/MSG-1/message/3289

--
Gerrit Holl
Deutscher Wetterdienst, division FE23
+49 (69) 8062-3171






AVHRR images in DWDSAT data — continued need?

Holl Gerrit
 

Hello,

as part of EUMETCast, the German Weather Service (DWD) distributes some weather data in the DWDSAT Service [1]. This service includes weather maps, meteograms, and text forecasts, among other things. It also includes AVHRR single-channel images and a SEVIRI HRV day/night composite for three areas over Europe, Central Europe, and Germany, such as the attached example over Central Europe.

At DWD we are updating our satellite processing software, including the software used to produce the PNG images from AVHRR and distributed via DWDSAT. I would like to know if there is a continued need for those images, and if it would be a problem to stop their broadcast in DWDSAT. EUMETCAST users already have access to AVHRR data as part of EARS, and I am not sure what the added value of the AVHRR images in DWDSAT would be. This broadcast was started a long time ago under my predecessor. Users needing PNG can quite easily produce single-channel images themselves using open-source software such as Pytroll[2]/Satpy[3] (which is the software we are transitioning to ourselves for AVHRR processing), and the SEVIRI VIS/HRV combination is not too hard to set up either (I think we're already producing this with Satpy).

Is anyone still using AVHRR data from DWDSAT? If yes, is there a continued need? What is the added value or advantage compared to data available in EARS?

best regards,
Gerrit Holl,
German Weather Service, Remote Sensing Application Development Division.

P.S. I saw references to a dedicated group for DWDSAT users, but I could not find a corresponding group after the migration to groups.io; I apologise if I missed it and if this is the wrong forum for this query.

[1] https://navigator.eumetsat.int/product/EO:EUM:DAT:MODEL:DWDSAT
[2] http://pytroll.github.io/
[3] https://satpy.readthedocs.io/en/stable/
[4] https://groups.io/g/MSG-1/message/3289

--
Gerrit Holl
Deutscher Wetterdienst, division FE23
+49 (69) 8062-3171


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Maurizio,

you have not pasted sgeorgia300 but only georgia300. Not exactly the same place. Add the 's' in front. Computers never forgive.

As I said: cut and paste ...

georgia300:
  description: Iceberg A68a (Sentinel-3A/3B)
  projection:
    proj: stere
    ellps: bessel
    lat_0: -55.00
    ....

And comment (#) the two debug lines in the script again.

Ernst

 


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

On Thu, Dec 17, 2020 at 10:14 PM, <maurizio.calvitti@...> wrote:

 

I cut and pasted your Sentinel-3 HOWTO update "sgeorgia300" into the C: /EMCtools/pppconfig/area.yaml files above (as the first area).

Maurizio,

The file is named areas.yaml not area.yaml. I just noted I misspelt it in my instructions. But in pppconfig there only was an areas.yaml to begin with.

Ernst


Re: Pytroll/SatPy for EUMETCast

maurizio.calvitti@...
 

Here is areas.rar, after copy and paste.

 

Regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: venerdì 18 dicembre 2020 08:21
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

It's perfectly O.K. that "sgeorgia300" is not found in Satpy's own areas.yaml as distributed. That's why you have a private version where you can do what you want.
Please attach a zipped copy of your private areas.yaml file to the next post (Windows C:\EMCtools\pppconfig\areas.yaml). Maybe you broke it with copy & paste ...

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Maurizio,

It's perfectly O.K. that "sgeorgia300" is not found in Satpy's own areas.yaml as distributed. That's why you have a private version where you can do what you want.
Please attach a zipped copy of your private areas.yaml file to the next post (Windows C:\EMCtools\pppconfig\areas.yaml). Maybe you broke it with copy & paste ...

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

maurizio.calvitti@...
 

 

Ernst,

I have produced a new debug file, I believe correctly.

 

I opened a miniconda3 prompt and typed the command echo% PPP_CONFIG_DIR%

print to screen C: / EMCtools / pppconfig = OK

 

I cut and pasted your Sentinel-3 HOWTO update "sgeorgia300" into the C: /EMCtools/pppconfig/area.yaml files above (as the first area).

 

(however these operations had been done from the beginning, not now)

 

As usual, I have two area.yaml files.

 

One in the path C: /EMCtools/pppconfig/area.yaml on which I pasted the instructions "sgeorgia300".

 

The other is a deeper path in 'C: \\\\ Users \\\\ Maurizio \\\\ miniconda3 \\\\ envs \\\\ pytroll \\\\ Lib \\\\ site-packages \ \\ \ satpy \\\\ etc \\\\ Areas.yaml \ ', \' C: \\\\ EMCtools \\\\ pppconfig \\\\ Areas.yaml \ '] ""

 

Opening this second file I can't find the "sgeorgia instructions". It's right?

 

regards

Maurizi

 

 

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: giovedì 17 dicembre 2020 22:20
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

what I see in this DEBUG.txt file:

1) There is no "DEBUG:" output in this file. That probably means you have not done what we just told you. Have you uncommented in the script the two lines (removed #)? I doubt it!
2) Satpy does not find your personal .../EMCtools/pppconfig directory or you have never copied the "sgeorgia300" area definition on top of your "areas.yaml" file in said directory.
3) I repeat: If you open a miniconda3 prompt or even a pure cmd window and type the command   echo %PPP_CONFIG_DIR%    it must print on the screen C:/EMCtools/pppconfig
    If it does not, you have not permanently set this necessary environment variable (I have told you many posts ago). It is point number "6) Environment variables" of the HOWTO.
    If you do not set this variable you cannot use any of the special areas I added like isleofman, westminster, switzerland, cyprus, and maybe later your personally added bellaitalia.
4) If you have set the variable PPP_CONFIG_DIR and it shows up with above echo command then you have not copied area "sgeorgia300" as explained in the Sentinel-3 Update.

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Maurizio,

what I see in this DEBUG.txt file:

1) There is no "DEBUG:" output in this file. That probably means you have not done what we just told you. Have you uncommented in the script the two lines (removed #)? I doubt it!
2) Satpy does not find your personal .../EMCtools/pppconfig directory or you have never copied the "sgeorgia300" area definition on top of your "areas.yaml" file in said directory.
3) I repeat: If you open a miniconda3 prompt or even a pure cmd window and type the command   echo %PPP_CONFIG_DIR%    it must print on the screen C:/EMCtools/pppconfig
    If it does not, you have not permanently set this necessary environment variable (I have told you many posts ago). It is point number "6) Environment variables" of the HOWTO.
    If you do not set this variable you cannot use any of the special areas I added like isleofman, westminster, switzerland, cyprus, and maybe later your personally added bellaitalia.
4) If you have set the variable PPP_CONFIG_DIR and it shows up with above echo command then you have not copied area "sgeorgia300" as explained in the Sentinel-3 Update.

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

maurizio.calvitti@...
 

Ernst,

attached is my debug text file…I

 

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: giovedì 17 dicembre 2020 20:07
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

Do exactly what Ferdinand told you. No indents if you remove # (it must be flush left). Then when starting the script at your miniconda3 (pytroll) prompt do what I have told you days back. Use the command:

python  Sentinel-3A.py  20201217  >  DEBUG.txt  2>&1

The screen will stay black for a while. When the prompt returns you will find a text file DEBUG.txt in your script directory. Move this to the desktop with Windows Explorer. Open it with notepad and study it.

If you still cannot find the problem, attach a copy to your next post. (BTW what you have done is redirection of stdout and stderr to a file. It's much easier than trying to send a screen copy of the output.)


Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Maurizio,

Do exactly what Ferdinand told you. No indents if you remove # (it must be flush left). Then when starting the script at your miniconda3 (pytroll) prompt do what I have told you days back. Use the command:

python  Sentinel-3A.py  20201217  >  DEBUG.txt  2>&1

The screen will stay black for a while. When the prompt returns you will find a text file DEBUG.txt in your script directory. Move this to the desktop with Windows Explorer. Open it with notepad and study it.

If you still cannot find the problem, attach a copy to your next post. (BTW what you have done is redirection of stdout and stderr to a file. It's much easier than trying to send a screen copy of the output.)


Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Mauricio,

 

There are two lines in the script that should be ‘uncommented’ to read:

# Why to hell is it not working?

from satpy.utils import debug_on

debug_on()

 

You will then follow loads of verbal comments to what is happening and usually a final conclusion.

 

Having the file paths correct is one thing, to have the required data present at the indicated path is another.

Continua a provarci, ci arrivarai di sicuro!

 

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of maurizio.calvitti@...
Sent: Thursday, 17 December, 2020 17:49
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Thank you Ferdinand,

Since I have succeeded  in processing and getting  beautiful images from Msg4, Noaa_20, FY-3D..etc…it is more difficult for me

to discover what is  going on with S3-A S3-B

I have carefully checked all the file paths as clearly explained in HOWTO, But I continue to see processed files in tmpdir but no images in the image folder.

 

As Should I run the debug function under Windows? Sorry, but I’m a biologist.

 

Cheers,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ferdinand Valk
Inviato: giovedì 17 dicembre 2020 11:53
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

 

I ran your Sentinel-3A.py with my own file paths and it works as advertised. As you do see the folders appearing in the tmpdir but no image, the only thing I can imagine is that you point the overlay line and the Logo lines to the wrong location or that you didn’t add the required files there.

If you run with the debug function and attentively sift through the produced debug info it should be clear what is going on.

 

Cheers,

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of maurizio.calvitti@...
Sent: Thursday, 17 December, 2020 08:39
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Ernst,

I checked point by point, so much so that I noticed an oversight in the guide you linked : ETCdata is correct? You mean EMCdata

Unfortunately I still have no images in the dedicated directories (ECMdata / images / Sentinel-3A or 3B), but only decompressed files in EMCdata/tmpdir xsen3a and x3senb.

It should be clear than with this mail,  I do not dare to ask for ready solutions, but only the confirmation that on your PC (I am referring to those who use SatPy on Windows) the attached shared S3 scripts (without any other further amendment) is  working.

 

My best regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: mercoledì 16 dicembre 2020 12:55
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

https://groups.io/g/MSG-1/message/30344

Ernst


Re: Pytroll/SatPy for EUMETCast

maurizio.calvitti@...
 

Thank you Ferdinand,

Since I have succeeded  in processing and getting  beautiful images from Msg4, Noaa_20, FY-3D..etc…it is more difficult for me

to discover what is  going on with S3-A S3-B

I have carefully checked all the file paths as clearly explained in HOWTO, But I continue to see processed files in tmpdir but no images in the image folder.

 

As Should I run the debug function under Windows? Sorry, but I’m a biologist.

 

Cheers,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ferdinand Valk
Inviato: giovedì 17 dicembre 2020 11:53
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

 

I ran your Sentinel-3A.py with my own file paths and it works as advertised. As you do see the folders appearing in the tmpdir but no image, the only thing I can imagine is that you point the overlay line and the Logo lines to the wrong location or that you didn’t add the required files there.

If you run with the debug function and attentively sift through the produced debug info it should be clear what is going on.

 

Cheers,

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of maurizio.calvitti@...
Sent: Thursday, 17 December, 2020 08:39
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Ernst,

I checked point by point, so much so that I noticed an oversight in the guide you linked : ETCdata is correct? You mean EMCdata

Unfortunately I still have no images in the dedicated directories (ECMdata / images / Sentinel-3A or 3B), but only decompressed files in EMCdata/tmpdir xsen3a and x3senb.

It should be clear than with this mail,  I do not dare to ask for ready solutions, but only the confirmation that on your PC (I am referring to those who use SatPy on Windows) the attached shared S3 scripts (without any other further amendment) is  working.

 

My best regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: mercoledì 16 dicembre 2020 12:55
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

https://groups.io/g/MSG-1/message/30344

Ernst


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

All,

A68 has now lost its first chunks at the blunt end precisely there where it
bumped at the elevated plateau of South Georgia. The sea floor there is
between 150 and 200 m deep; providing a minimum thickness of A68.

Ferdinand


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Maurizio,

 

I ran your Sentinel-3A.py with my own file paths and it works as advertised. As you do see the folders appearing in the tmpdir but no image, the only thing I can imagine is that you point the overlay line and the Logo lines to the wrong location or that you didn’t add the required files there.

If you run with the debug function and attentively sift through the produced debug info it should be clear what is going on.

 

Cheers,

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of maurizio.calvitti@...
Sent: Thursday, 17 December, 2020 08:39
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Ernst,

I checked point by point, so much so that I noticed an oversight in the guide you linked : ETCdata is correct? You mean EMCdata

Unfortunately I still have no images in the dedicated directories (ECMdata / images / Sentinel-3A or 3B), but only decompressed files in EMCdata/tmpdir xsen3a and x3senb.

It should be clear than with this mail,  I do not dare to ask for ready solutions, but only the confirmation that on your PC (I am referring to those who use SatPy on Windows) the attached shared S3 scripts (without any other further amendment) is  working.

 

My best regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: mercoledì 16 dicembre 2020 12:55
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

https://groups.io/g/MSG-1/message/30344

Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Mauriziao,

It's always EMCtools and EMCdata (not ETCdata nor ECMdata). Maybe I typod it somewhere in a post or *.txt as well.

1) These files work under Windows, Ferdinand has just recently published images on MSG-1.
2) Do you have at least a S3A.png or S3B.png in the respective tmpdirs???
2a) If not check the environment variables part of the installation HOWTO. At the prompt command " echo  %PPP_CONFIG_DIR%" should not be empty!
2b) If yes check that you have made the subdirectory ...EMCdata\logos and copied the two image files from the Sentinel-3 Update there.

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

maurizio.calvitti@...
 

Ernst,

I checked point by point, so much so that I noticed an oversight in the guide you linked : ETCdata is correct? You mean EMCdata

Unfortunately I still have no images in the dedicated directories (ECMdata / images / Sentinel-3A or 3B), but only decompressed files in EMCdata/tmpdir xsen3a and x3senb.

It should be clear than with this mail,  I do not dare to ask for ready solutions, but only the confirmation that on your PC (I am referring to those who use SatPy on Windows) the attached shared S3 scripts (without any other further amendment) is  working.

 

My best regards,

Maurizio

 

Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di Ernst Lobsiger via groups.io
Inviato: mercoledì 16 dicembre 2020 12:55
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Maurizio,

https://groups.io/g/MSG-1/message/30344

Ernst


Re: experiences and lessons learned with a fresh Eumetcast install for WIndows and Linux

George Sz
 

Ernst,

I did take care of smcroutectl kill and put phyint disable entries into smcroute.conf, essentially accomplishing what you did. As for dvb-eumetcast stop, I seldom issue that command. I mean, why would I?

Regards,
George

1001 - 1020 of 31500