Date   

Re: Meteosat AMV data

Hamdan
 

yeah, I removed the spaces and now works fine.

Thanks David 


Re: PyTROLL/SatPy Starter Kit V3.0 for GNU/Linux

Ernst Lobsiger
 

Dear All

While we had a script for Electro-L N2 (GOMS2) as geostationary satellite at 76E in the Starter Kit V1.0 there is no such script in the Starter Kit V3.0.
The reason for this is still found on https://uns.eumetsat.int/  searching for "Electro" ...
<cite>
Due to the ongoing relocation of Electro L-N2 to its new position at 14.5W, the Electro-L-N2 service has been suspended as of 21/07/2020 at 09:30 UTC
</cite>

Now Electro-L N3 (GOMS3) has taken the place of former Electro-L N2 (GOMS2) and EUMETSAT is testing dissemination of the same data we had
before from Electro-L N2. This is 6 channels of full disk 4km at SSP every 30 minutes. The tests started yesterday. Here is some info from EUMETSAT:

<cite>

The file format is compressed XRIT and the filenames have the following scheme:

...

Example:

H-000-GOMS3_-GOMS3_4_____-11_9_076E-000006___-202101112100-C_

 

The data will be distributed on EUMETCast Europe:

 

Channel: E1B-TPG-1

Multicast address: 224.223.222.27

PID: 500

Access to these data will be automatically provided for Member State NMHSs and registered manufacturers. Following a successful trial, it is planned to make them available to the wider User community.
</cite>

While the data is not yet available to everybody I got hold of some files and adapted a MSG3.py for this offer that should start rather soon.
Users of the Starter Kit V3.0 can certainly make a similar GOMS3.py script also having an eye on what we used in Starter Kit V1.0. There
is a possible small fix for the PyTROLL/Satpy 'electrol_hrit' reader that currently only lists N1 and N2. I'll discuss that with the developers.

Here my first results.

Cheers,
Ernst




Re: Meteosat AMV data

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 25/03/2021 12:12, Hamdan via groups.io wrote:
Hi everybody,
I am trying to visualize Meteosat-8 AMV Bufr files using the latest version of "Bufr Viewer software" which is V2.1.175, 2021-Feb-23
But the software is unable to process and visualize these files !
Any Suggestions ?
Best Regards
Hamdan,

Sorry to hear you are having problems. Please try without spaces in the file name.

That same data file does work here. As a check, it is 2,601,973 bytes in size. See the attached plot.

Thanks,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Meteosat AMV data

Hamdan
 

Hi everybody,

I am trying to visualize Meteosat-8 AMV Bufr files using the latest version of "Bufr Viewer software" which is V2.1.175, 2021-Feb-23

But the software is unable to process and visualize these files !

Any Suggestions ?

Best Regards 

 


Re: Pytroll/Satpy MSG3 IR

Ernst Lobsiger
 

On Sun, Mar 21, 2021 at 01:28 PM, Daniele Guardigli wrote:
Ok thank you! In fact what I need is the "inverted" IR_108.
Daniele,

you have to learn how to make your own composites. For simple things like inverting a channel there is plenty of documentation.

https://satpy.readthedocs.io/en/latest/composites.html

You have to RTFM. We cannot repeat everything here. And finally you have to tell my scripts about your new composites ...

Regards,
Ernst


Re: Pytroll/Satpy MSG3 IR

Daniele Guardigli
 

Ok thank you! In fact what I need is the "inverted" IR_108.


Il giorno dom 21 mar 2021 alle ore 21:25 Christian Peters via groups.io <hctpeters=yahoo.com@groups.io> ha scritto:
Ernst and Daniele, 

keep in mind if you use IR_108 you get "cold black clouds". 



If you want something like this, 


you have to add a custom composite or invert the resulting image with ImageMagick e.g.

Regards,

Christian 

Am 21.03.2021 um 21:01 schrieb Ernst Lobsiger via groups.io <ernst.lobsiger@...>:

Daniele,

You can add any single channel image (not really a 'composite') using the channel names in the header table.
Use 3 times exactly as named in the table, the abbreviated string can be lowercase or whatever as you decide.
Then as 'composite' use again the channel name. MSG3 is RSS sat, there are no full disk images! Example:

...
composite = 'IR_108'
...
# We only decompress what is actually needed, see file seviri.yaml
needed_files = {'overview'         : ['VIS006', 'VIS008', 'IR_108'],
                'natural_color'    : ['VIS006', 'VIS008', 'IR_016'],
                'realistic_colors' : ['VIS006', 'VIS008', 'HRV'],
                'hrv_clouds'       : ['IR_108', 'HRV'],
                'night_fog'        : ['IR_039', 'IR_108', 'IR_120', 'IR_134'],
                'ir108_3d'         : ['IR_108'],
                'IR_108'           : ['IR_108']}
# Some composite names are too long for IM annotation left of pic
abbreviation = {'overview'         : 'overview',
                'natural_color'    : 'natural_color',
                'realistic_colors' : 'realist_color',
                'hrv_clouds'       : 'hrv_clouds',
                'night_fog'        : 'night_fog',
                'ir108_3d'         : 'ir108_3d',
                'IR_108'           : 'ir108'}
...

Good luck
Ernst



--
Daniele Guardigli


Re: Pytroll/Satpy MSG3 IR

Christian Peters
 

Ernst and Daniele, 

keep in mind if you use IR_108 you get "cold black clouds". 



If you want something like this, 


you have to add a custom composite or invert the resulting image with ImageMagick e.g.

Regards,

Christian 

Am 21.03.2021 um 21:01 schrieb Ernst Lobsiger via groups.io <ernst.lobsiger@...>:

Daniele,

You can add any single channel image (not really a 'composite') using the channel names in the header table.
Use 3 times exactly as named in the table, the abbreviated string can be lowercase or whatever as you decide.
Then as 'composite' use again the channel name. MSG3 is RSS sat, there are no full disk images! Example:

...
composite = 'IR_108'
...
# We only decompress what is actually needed, see file seviri.yaml
needed_files = {'overview'         : ['VIS006', 'VIS008', 'IR_108'],
                'natural_color'    : ['VIS006', 'VIS008', 'IR_016'],
                'realistic_colors' : ['VIS006', 'VIS008', 'HRV'],
                'hrv_clouds'       : ['IR_108', 'HRV'],
                'night_fog'        : ['IR_039', 'IR_108', 'IR_120', 'IR_134'],
                'ir108_3d'         : ['IR_108'],
                'IR_108'           : ['IR_108']}
# Some composite names are too long for IM annotation left of pic
abbreviation = {'overview'         : 'overview',
                'natural_color'    : 'natural_color',
                'realistic_colors' : 'realist_color',
                'hrv_clouds'       : 'hrv_clouds',
                'night_fog'        : 'night_fog',
                'ir108_3d'         : 'ir108_3d',
                'IR_108'           : 'ir108'}
...

Good luck
Ernst


Re: Pytroll/Satpy MSG3 IR

Ernst Lobsiger
 

Daniele,

You can add any single channel image (not really a 'composite') using the channel names in the header table.
Use 3 times exactly as named in the table, the abbreviated string can be lowercase or whatever as you decide.
Then as 'composite' use again the channel name. MSG3 is RSS sat, there are no full disk images! Example:

...
composite = 'IR_108'
...
# We only decompress what is actually needed, see file seviri.yaml
needed_files = {'overview'         : ['VIS006', 'VIS008', 'IR_108'],
                'natural_color'    : ['VIS006', 'VIS008', 'IR_016'],
                'realistic_colors' : ['VIS006', 'VIS008', 'HRV'],
                'hrv_clouds'       : ['IR_108', 'HRV'],
                'night_fog'        : ['IR_039', 'IR_108', 'IR_120', 'IR_134'],
                'ir108_3d'         : ['IR_108'],
                'IR_108'           : ['IR_108']}
# Some composite names are too long for IM annotation left of pic
abbreviation = {'overview'         : 'overview',
                'natural_color'    : 'natural_color',
                'realistic_colors' : 'realist_color',
                'hrv_clouds'       : 'hrv_clouds',
                'night_fog'        : 'night_fog',
                'ir108_3d'         : 'ir108_3d',
                'IR_108'           : 'ir108'}
...

Good luck
Ernst


Pytroll/Satpy MSG3 IR

Daniele Guardigli
 

Hello,

can anyone help me on setting composite IR 108 instead of IR-1083D? Thanks

--
Daniele Guardigli


Re: GOES ABI Manager

maurizio.calvitti@...
 

Many thanks David,
I have checked the configuration and applied your suggested settings and now it works!!

Ciao
Maurizio

-----Messaggio originale-----
Da: MSG-1@groups.io <MSG-1@groups.io> Per conto di David J Taylor GM8ARV ?????????????? ???? via groups.io
Inviato: domenica 21 marzo 2021 15:50
A: MSG-1@groups.io
Oggetto: Re: [MSG-1] GOES ABI Manager

On 21/03/2021 12:53, maurizio.calvitti@enea.it wrote:
Thank you for your support.

Eumetcastview works perfectly and decode my GOES ABI Files (both GOES
16 and 17)

At this moment I have no idea how let GOES ABI manager work!

It continues to give me the message: failed for all files found in the
directory.
Maurizio,

Sorry to hear you are still having problems. If the program used to work, and no longer does, you need to ask what changed on your PC.

- are any disks full?

- do the three directories on the setup page exist?

- are those directories all writeable - can the program delete the files it has processed?

My recommended settings are:

Save as NetCDF: unchecked.
Save as JPEG: checked.
Save as PNG: unchecked.

Dates in folders: checked.

Clear images: unchecked.
Short image names: checked.

Select bands: all mine are checked.

GeoSatSignal job number: all mine are 0.

Ciao,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: GOES ABI Manager

geojohnt@...
 

David,

Thanks for your comments.

My MSG Data Manager is set to:
Text message retention 3.
Daily log retention 2.

Ah, I see what seems to be happening.

My Info-Channel-2 data goes to \bas\Info-Channel-2 folder - as you show below.
But, my MDM Tellicast received files location is:
E:\EUMETCast\received\bas\default\

So MDM text/log retention has nothing to regularly delete. 
Meanwhile the contents of the Info-Channel-2 folder continues to fill 'untrimmed.'

Which means(?) if I direct Info-Channel-2 data to the EUMETCast default folder, MDM will pick it up and trim it depending on the retention period.

I see from my bas\default folder that 

E1B-TPG-1.
E1B-TPL-1.
Data Channel-2.
Data Channel-12.

all go to this folder.

And of course as you say, I could just comment out Info-Channel-2.

Regards,
John

++++++++++++++++++++++++++++++++++++++

John,

The E-UNS files are handled (if enabled) by the MSG Data Manager.
Here's how I have mine sent:

[channel]
name=Info-Channel-2
target_directory=Z:\EUMETCast\received\bas\Info-Channel-2

In Setup, Channel Selection, MSG-HRIT, you may want to set "Text message
retention" and "Daily log retention" to a non-zero value to ensure the
processed files are deleted.

The current beta version is: MSG Data Manager - V3.1.15.1317

Likely you could just comment out "Info-Channel-2" if you don't need the
data:

# [channel]
# name=Info-Channel-2
# target_directory=Z:\EUMETCast\received\bas\Info-Channel-2

My programs are typically call "Manager" because whilst receiving the
data is relatively straight-forward (ahem) controlling the terabyte of
data which could be flowing into your system every day is not!

Cheers,
David
--


-----Original Message-----
From: David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 via groups.io <david-taylor@...>
To: MSG-1@groups.io
Sent: Sun, 21 Mar 2021 15:10
Subject: Re: [MSG-1] GOES ABI Manager

On 21/03/2021 12:48, geojohnt via groups.io wrote:
> David and All,
>
> I was interested to read about 'unprocessed files clogging up the
> system' in the above postings.
>
>>However, there are many unwanted files in the \received\E1H-TPG-1\
>>directory,
>
> I recall a time - when? - that I suffered all sorts of accumulating
> unwanted files when setting up a new system(?) and or going over to the
> 'new' TC software?
> Probably when I started to receiver HVS-1 as well as Basic and my HD was
> filling up by the hour.
>
> My solution (along with your advice) was to cull a lot data channels via
> TC cast_client_channels.ini and possibly being more specific in data
> routing not just pointing many of them to a default folder.
> And of course the 'behind the scenes' auto deleting of unwanted data
> built into to your processing programme software.
>
> Also not to request in ones personal EUMETSAT data account all the
> EUMETCast services that are disseminated.
> Originally I just ticked everything.
>
> Of course all this is well known by experienced users and goes without
> saying.
> But hopefully any new members here might find this of use.
>
> Regarding TrimTree, you have quite often suggested I use this but 'you
> know me.'
> I don't like fiddling around.
> And actually I have never needed to use this to my knowledge.
> My HD Data E: just sits there year after year, 24/7 operation, at 1.45
> TB free space on a 1.81 TB HD.
>
> However, I have just noticed that my received > bas > Info-Channel 2
> folder contains 4.40 GB's of accumulated E-UNS files dating from
> 22/07/2019 to the present.
>
> Now I know what you are going to say .......
> But I have just manually deleted them (:-))
>
> Regards,
> John.






Re: GOES ABI Manager

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 21/03/2021 15:23, Thorsten Miglus wrote:
David,
The program is started with the -START option.
The images are loaded until the bad image is found.
Afterwards processing starts but a fail message appers for all incoming files.
You can simulate this by yourself.
Just replace an image with a file of zero length and the same name.
Then start the ABI Manager.
Now watch what happens...
Cheers
Thorsten
Thorsten,

Thanks for reporting that. V2019.4.20.39 fixed the zero-length file on restore images issue. I've just updated the program to fix the new issue for zero length downloaded data and uploaded an update:

https://www.satsignal.eu/software/GOES-ABI-Manager.html
V2021.3.21.40 is at the bottom of the page.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: Pictures from Satellite Uplink Aflenz

geojohnt@...
 

Hello Hartmut,

Thanks for the photos of your visit to Aflenz.
Very interesting.

And dare I say, they show the 'problem' for GEO and other 'amateur radio clubs' - the age group of members, myself included.

Looks like you all had a great day.

Best wishes,
John Tellick.


-----Original Message-----
From: Hartmut Schulla via groups.io <mail@...>
To: MSG-1@groups.io <MSG-1@groups.io>
Sent: Sun, 21 Mar 2021 15:22
Subject: [MSG-1] Pictures from Satellite Uplink Aflenz


Re: HVS-2 problems

Ernst Lobsiger
 

Douglas,

I am not taking the additional Sentinel-3A/B data for manufacturers that you mention. But this only affects the blue part in my traffic graph. The yellow part shows all traffic disseminated. All bars are 5 minute averages though.

Regards,
Ernst


Re: HVS-2 problems

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 21/03/2021 15:21, Douglas Deans via groups.io wrote:
I am not taking HVS-2 at the moment but I wonder if they are testing this :-
Dear Manufacturer,
The Sentinel-3A/B OLCI Level 2 Full Resolution (FR) NRT product is
currently distributed on EUMETCast Terrestrial.
On 7 April 2021, we will start a trial dissemination of this product on
EUMETCast Europe, High Volume Service Transponder 2:
- For Sentinel-3A OLCI L2 FR:
Douglas,

Yes, that's possible, and when I first saw that I wondered where they were going to fit it in. I was unsure of the data volumes involved especially when "full resolution" was mentioned, but I think it's water temperature, so likely just a single channel. But tests before a trial are the norm.

Sometime this year Sentinel data is removed from HVS-2, IIRC, presumably to make way for MTG and EPS-NG tests?

73,
David GM8ARV
--
David
Web: http://www.satsignal.eu


Re: GOES ABI Manager

Thorsten Miglus
 

David,

The program is started with the -START option.
The images are loaded until the bad image is found.
Afterwards processing starts but a fail message appers for all incoming files.
You can simulate this by yourself.
Just replace an image with a file of zero length and the same name.
Then start the ABI Manager.
Now watch what happens...

Cheers
Thorsten


On Sun, Mar 21, 2021 at 12:47 PM, David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 wrote:
OK, and does the program start if you then press the Start button?

David


Pictures from Satellite Uplink Aflenz

Hartmut Schulla
 


Re: HVS-2 problems

Douglas Deans
 

On 21/03/2021 12:28, Ernst Lobsiger via groups.io wrote:
On Sun, Mar 21, 2021 at 04:52 AM, David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 wrote:
I noted that the interval between the losses is about 1 Sentinel
orbit period.
David,
it even seems that the missed/recovered bursts are in sync with strong multicast traffic drops.
Regards,
Ernst
===========================================================================

I am not taking HVS-2 at the moment but I wonder if they are testing this :-

Dear Manufacturer,

The Sentinel-3A/B OLCI Level 2 Full Resolution (FR) NRT product is currently distributed on EUMETCast Terrestrial.

On 7 April 2021, we will start a trial dissemination of this product on EUMETCast Europe, High Volume Service Transponder 2:
- For Sentinel-3A OLCI L2 FR:

Channel: E2H-S3A-10

Multicast address: 224.232.224.12

PID: 610
- For Sentinel-3B OLCI L2 FR:

Channel: E2H-S3B-10
Multicast address: 224.232.224.13
PID: 610
Example filenames:

S3A_OL_2_WFR____20210317T095941_20210317T100241_20210317T115127_0179_069_307_3600_MAR_O_NR_003.SEN3.tar

S3B_OL_2_WFR____20210317T154915_20210317T155215_20210317T180358_0179_050_168_2700_MAR_O_NR_003.SEN3.tar

NOTE:
In order to receive the new channels’ data on dedicated target directories, users need to edit cast_client-channels_hvs-2.ini and add the following sections for the new channels:
[channel]

name=E2H-S3A-10

target_directory=<target dir…>

tmp_directory=<tmp dir…>

[channel]

name=E2H-S3B-10

target_directory=<target dir…>

tmp_directory=<tmp dir…>

If the sections above are not added to cast_client-channels_hvs-2.ini, the data will be received under the target directory of the default channel (name=*) in case it is defined.


Regards,
Douglas.


Re: HVS-2 problems

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 21/03/2021 12:28, Ernst Lobsiger via groups.io wrote:
David,
it even seems that the missed/recovered bursts are in sync with strong multicast traffic drops.
Regards,
Ernst
Trying to push that extra data through when there /might/ be room!

David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: GOES ABI Manager

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 21/03/2021 12:48, geojohnt via groups.io wrote:
David and All,
I was interested to read about 'unprocessed files clogging up the system' in the above postings.

However, there are many unwanted files in the \received\E1H-TPG-1\
directory,
I recall a time - when? - that I suffered all sorts of accumulating unwanted files when setting up a new system(?) and or going over to the 'new' TC software?
Probably when I started to receiver HVS-1 as well as Basic and my HD was filling up by the hour.
My solution (along with your advice) was to cull a lot data channels via TC cast_client_channels.ini and possibly being more specific in data routing not just pointing many of them to a default folder.
And of course the 'behind the scenes' auto deleting of unwanted data built into to your processing programme software.
Also not to request in ones personal EUMETSAT data account all the EUMETCast services that are disseminated.
Originally I just ticked everything.
Of course all this is well known by experienced users and goes without saying.
But hopefully any new members here might find this of use.
Regarding TrimTree, you have quite often suggested I use this but 'you know me.'
I don't like fiddling around.
And actually I have never needed to use this to my knowledge.
My HD Data E: just sits there year after year, 24/7 operation, at 1.45 TB free space on a 1.81 TB HD.
However, I have just noticed that my received > bas > Info-Channel 2 folder contains 4.40 GB's of accumulated E-UNS files dating from 22/07/2019 to the present.
Now I know what you are going to say .......
But I have just manually deleted them (:-))
Regards,
John.
John,

The E-UNS files are handled (if enabled) by the MSG Data Manager. Here's how I have mine sent:

[channel]
name=Info-Channel-2
target_directory=Z:\EUMETCast\received\bas\Info-Channel-2

In Setup, Channel Selection, MSG-HRIT, you may want to set "Text message retention" and "Daily log retention" to a non-zero value to ensure the processed files are deleted.

The current beta version is: MSG Data Manager - V3.1.15.1317

Likely you could just comment out "Info-Channel-2" if you don't need the data:

# [channel]
# name=Info-Channel-2
# target_directory=Z:\EUMETCast\received\bas\Info-Channel-2

My programs are typically call "Manager" because whilst receiving the data is relatively straight-forward (ahem) controlling the terabyte of data which could be flowing into your system every day is not!

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv

421 - 440 of 31611