Date   

Re: TC error messages.

geojohnt@...
 

David and Ernst,

Thanks for both your comments.

>John,

>This appears to have been an error at EUMETSAT, as it's been seen here and at
>Arne's too.  Nothing to worry about.

>Cheers,
>David

And Ernst:

>if your tmp and received are on the same partition rename is the normal process of "moving" >a fully received tmp file to the received/channel folder. This is actually done by (fast) hard >links which means no data has to be moved at all. This has all been described im my >documentation for MVMSG.cmd (see my latest reply for Alan). The documentation is still in >the MSG-1 file secton in the MVMSG.cmd DISTRO 022 though it's rather technical and >certainly not everybody's business.

>IIRC we had this message a few times and it was a transmission problem on the uplink side >>(not sure). On GNU/Linux you get this message for every file if tmp and received is on >different file systems (partitions) and nothing works!!

Everything else was working OK - so it was interesting to hear some also saw this message at the same time.

Regards,
John

++++++++++++++++++++

-----Original Message-----
From: David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 via groups.io <david-taylor@...>
To: MSG-1@groups.io
Sent: Fri, 15 Oct 2021 16:19
Subject: Re: [MSG-1] TC error messages.

On 15/10/2021 09:34, geojohnt via groups.io wrote:

> All,
>
> I had an overnight error message the other day which I don't think I've seen
> before.
>
> Lvl:Date Time (UTC) :Message
> ERR:2021-10-14 00:54:13.085:Cannot rename file
> "\EUMETCast\tmp\bas\61677f41031979db.tmp" to
> "\EUMETCast\received\bas\default\Z_SATE_C_BABJ_2021101400000pO_FY2H_PRE_024_NOM.AWX.gz"
> (Invalid argument)
>
> "Cannot rename file" - not that I look much at the error messages, just clear them.
> But do some files need to be 'renamed?'
> If so, why?
>
> Regards,
> John Tellick.



Re: RamDisk size for HVS-2

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

The occasional errors in dissemination appear to have remained in the last day
or two, so caution may be needed in interpreting changes!

I handle the stale "tmp" files with a simple TrimTree command:

TrimTree 120m Z:\EUMETCast\tmp\ *

which is run regularly.

There are changes afoot for Metop-A and Sentinel data over EUMETCast over the
next couple of months, but I don't yet know what is planned to fill the
bandwidth vacated! GOES-16/17 data has been subject to interruption.

In the last couple of days I noticed 250m and 500m wind data incoming.
Although this was caught by a daily trim of \received\, I added it to a regular
TrimTree of data which I don't use.

"W_NL-KNMI-DeBilt,SURFACE+SATELLITE,HY-2?+HSCAT_C_EHDB_2*_o_*_ovw_l2.bin"

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Re: RamDisk size for HVS-2

Alan Curnow
 

Ernst,

From your last post it would appear that all those tmp files 1 to 2 hours since last modified are actually broken and cluttering up the ramdisk. On David's PC Lund graphs his tmp files only exceeded 5MB twice in a year and only once over 5.5MB so I may get away with my Ramdisk as it is though it would be nice not to have such clutter.

On your documentation for MVMSG you also stored your hvs-2 received files on the ramdisk before moving them. As they can be 700MB or so in size I didn't think that was feasible but it seems to work fine for you in 4GB as long as you get rid of the broken tmp files. I'll send you a PM of my setup as I'd be interested in doing that.

Regarding log errors I exaggerated the 10 mins, over the last 24 hours it was

HVS-2
17 entries for 'Missed parts of file....'
22 entries for 'Lost  xx messages in the last 60 seconds...' right after disconnecting from a channel. Don't know if that is a problem.

HVS-1
Hundreds of file missing/incomplete entries referring to GOES 17. No errors apparantly on other satellites.

Basic
No Lost or Missed entries.
Hundreds of file missing/incomplete messages right after disconnecting from a Data Channel 1, 2 and 5 channels like this
MSG:2021-10-15 00:49:07.818:File transmission eefa8c14031f25ad interrupted: 6 files missing/incomplete 
Not sure how critical they are as my Satsignal checks of MSG, Himawari, Metop etc images always seems complete without missing or corrupt segments.

Cheers,
Alan
 


Re: RamDisk size for HVS-2

Thorsten Miglus
 

Hello,

The removal of OLCI Level-1 Full Resolution Near Real Time data from EUMETCast Satellite will take place on 15 December 2021.

Cheers,
Thorsten


Re: RamDisk size for HVS-2

Ernst Lobsiger
 

Alan,

if you have already solved the transfer problem of received RAM-disk --> HDD then remains the broken tmp files. In one post you said to have a missed/incomplete HVS-2 files every 10 minutes. This is far too high for whatever reason (with your SNR of 16dB you should rather have one missed/incomplete file per day). Assuming these are OLCI EFR files of typically 700MB would mean you get 700MB more every 10 minutes that hang around for the next 3 hours.

This is in a nutshell what I found out: EUMETSAT can set a kind of timeout per product disseminated. This used to be 3 hours for OLCI EFR files but can be up to 24 hours for other low priority stuff according to KP. When you have missed (missed/unrecovered = lost) packets in the stream to that file it will hang around as incomplete tmp (actually full 700MB but with some 0 filled hole in it) and wait to be fixed. After the set timeout the client will delete a still incomplete tmp. It can be fixed by retransmissions within the set delay that EIP (Extremly Important Persons) can ask for (NACKs). Perhaps EUMETSAT also has a network of reference receivers so that they can detect widespread reception problems (maybe caused by their uplink) and initiate retransmission for those specific cases automatically. But the fact is most missed/incomplete files we get are caused by our local receiver problems EUMETSAT will never know about and will certainly not send some more extra packets for an amateur user in Cyprus or Sweden. That's why I asked EUMETSAT for the client switch I was talking about. With that switch every station that wants to use RAM-disks can decide whether the client should delete missed/incomplete files immediately. In this case you can forget tmp file management and just organize the RAM-disk ---> HDD transfer for fully received files. As a matter of fact, as the Windows client can even have tmp and received on different file systems (I don't recommend that), you could just have an unmanaged RAM-disk as a dynamic buffer for tmp files. More details in my two two papers inside the MVMSG 0.22 distribution that you will certainly understand.


Regards,
Ernst

P.S.
Just recently we suffered from sun satellite antenna colinearity (solar outage) that occurs twice a year.
This of course is a main RAM-disk filler event if broken HVS-2 tmp files are not deleted fast enough.


Re: RamDisk size for HVS-2

Alan Curnow
 

Thanks again Ernst for your information. I'll read the info you posted with interest and report back. Also thanks to David for his info.

This afternoon I checked and the swap file was 1 file of 100MB and 2mins old, so all the temp files that were created yesterday must have been genuine and correct and the 4.9GB peak I reached yesterday was all genuine valid data so it seems couldn't have been cleared earlier to free space.
Interestingly for the past few hours the hvs-2 swap usage has only peaked at around 500MB, presumably as only one Sentinal satellite happens to be downloading at a time.

For Bas and HVS-1 I do write the Tellicast received files to the ramdisk too, and wrote a Windows program to transfer them to two directory structures on my 2TB EUMETCast storage disk every 30 secs, one a copy of the received directories for use by Satpy or EumetCastView, while the other directory structure is the one needed by Satsignal software with some directories renamed or combined. This is so Satsignal can delete them when processed. I did try not deleting them so all programs could use the one directory structure but Satsignal processing took much longer as it kept searching through thousands of files for new ones. This only used 100MB of ramdisk in total so was no problem.

This won't work for HVS-2 as completed files are so much larger, so are written direct to the main EUMETCast storage disk. For the moment I may try risking using a 5.5GB ramdisk for hvs-2 tmp files too, and see how long it survives for. :)

I'm only just starting trying out Satpy/trollImage and Python so am not very good at it yet. I'm used to C and C++, so hopefully will get the hang of it quickly.

Cheers,
Alan


Re: RamDisk size for HVS-2

Ernst Lobsiger
 

On Fri, Oct 15, 2021 at 08:17 AM, David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 wrote:
The simple Robocopy approach works extremely well, and is much easier to
understand.
David,

I agree that MVMSG.cmd is hard to understand which is not my fault as Windows CMD is rather a botch than a shell. One of the big problems was to get file modification times and actual file sizes while the temp files are open and the client is writing. NTFS was just lying and FAT32 had other problems I don't remember. I also agree with your trim down guidance as I have one of my Fujitsu/Siemens 2009 Core2 Duo with 8GB RAM, 2 old Hitachi CMR disks and no RAM disk that can run at 100% system load receiveing with a 20 Euro Skystar 2 eXpress HD catching up with LaPalma RSS frames from some days back and producing webm videos with ffmpeg at the same time without loosing a single multicast packet :-).

Cheers,
Ernst


Re: TC error messages.

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 15/10/2021 09:34, geojohnt via groups.io wrote:
All,

I had an overnight error message the other day which I don't think I've seen
before.

Lvl:Date Time (UTC) :Message
ERR:2021-10-14 00:54:13.085:Cannot rename file
"\EUMETCast\tmp\bas\61677f41031979db.tmp" to
"\EUMETCast\received\bas\default\Z_SATE_C_BABJ_2021101400000pO_FY2H_PRE_024_NOM.AWX.gz"
(Invalid argument)

"Cannot rename file" - not that I look much at the error messages, just clear them.
But do some files need to be 'renamed?'
If so, why?

Regards,
John Tellick.
John,

This appears to have been an error at EUMETSAT, as it's been seen here and at
Arne's too. Nothing to worry about.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Re: RamDisk size for HVS-2

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

On 15/10/2021 09:18, Ernst Lobsiger via groups.io wrote:
David uses and describes a much simpler approach based on robocopy.exe and
trimtree.exe on his site but I doubt this can do what my MVMSG.cmd actually
does. I also note that he uses RAM-disk sizes up to 8GB (see e.g. his PC Lund).
Here, at the extremities of the satellite footprint, and with a dish that is
too sensitive to wind, I have much worse reception conditions than those in
central Europe!

The simple Robocopy approach works extremely well, and is much easier to
understand.

My PC Lund receives the full HVS-1 and HVS-2 on a single card:

https://www.satsignal.eu/mrtg/lund-ramdisk-trees.html

My PC Kiruna receives HVS-1 along and has no RAMdisk. Data is sent directly to
a separate 1 TB CRM hard disk.

Yes, Lund has an 8 GB RAMdisk, but you might argue that if there are such
issues that a RAMdisk that big is needed, will the data be good enough to
justify reception in the first place?

Recent experience is that when the GOES-16/17 data goes offline from the USA,
and EUMETSAT attempt to catch up, the HVS-1 data stream is overloaded in any
case. I see this both here and at Arne's.

The guidance? Get a 32 GB PC and be prepared to devote 8 GB to a RAMdisk.
Monitor it, and trim downwards as meets your particular needs.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Re: TC error messages.

Ernst Lobsiger
 

On Fri, Oct 15, 2021 at 01:34 AM, <geojohnt@...> wrote:
But do some files need to be 'renamed?'
If so, why?
John,

if your tmp and received are on the same partition rename is the normal process of "moving" a fully received tmp file to the received/channel folder. This is actually done by (fast) hard links which means no data has to be moved at all. This has all been described im my documentation for MVMSG.cmd (see my latest reply for Alan). The documentation is still in the MSG-1 file secton in the MVMSG.cmd DISTRO 022 though it's rather technical and certainly not everybody's business.

IIRC we had this message a few times and it was a transmission problem on the uplink side (not sure). On GNU/Linux you get this message for every file if tmp and received is on different file systems (partitions) and nothing works!!

Regards,
Ernst



TC error messages.

geojohnt@...
 

All,

I had an overnight error message the other day which I don't think I've seen before.

Lvl:Date       Time (UTC)  :Message
ERR:2021-10-14 00:54:13.085:Cannot rename file "\EUMETCast\tmp\bas\61677f41031979db.tmp" to "\EUMETCast\received\bas\default\Z_SATE_C_BABJ_2021101400000pO_FY2H_PRE_024_NOM.AWX.gz" (Invalid argument)
"Cannot rename file" - not that I look much at the error messages, just clear them.
But do some files need to be 'renamed?'
If so, why?

Regards,
John Tellick.









Re: RamDisk size for HVS-2

Ernst Lobsiger
 

<cite>
It's odd that on your system you never exceed 1.5GB used on the Ramdisk, unless the Windows and Linux versions of Tellicast are different in some way.
</cite>

Alan,

given your 1.8m dish and the experiments you just described you are certainly not an average Windows TelliCast user. I also had a look at your rare posts that show that you have the potential to understand and use my MVMSG.cmd. You still find the DISTRO 0.22 in the MSG-1 file section (login, go to files and search for MVMSG). The zip contains my papers with the technical background. I have written this on my Windows 7 desktop before T2 and HVS-2 even existed. It uses an NTFS-formatted RAM-disk. The reason for this are rather technical except for the fact that I had no Windows RAM-disk at all and I found it outright ridiculous to have to pay for such an ADD-on. I actually simulated a Windows 7 TelliCast receiver (something I never had and never will have) and a RAM-disk with an external ZIP-100 drive that I formatted FAT32 and NTFS.

David uses and describes a much simpler approach based on robocopy.exe and trimtree.exe on his site but I doubt this can do what my MVMSG.cmd actually does. I also note that he uses RAM-disk sizes up to 8GB (see e.g. his PC Lund).

https://www.satsignal.eu/wxsat/Ayecka/RAMdisk-HVS.html

https://www.satsignal.eu/mrtg/lund-ramdisk-trees.html

The only persons I know to have used MVMSG.cmd are well known Arne van Belle (my Beta tester for this project) and Emmanuel "Manu" Dupré (he made me brush up my frech). I also made a special version that can handle 4 TC clients. Arne used this version to demonstrate that his TBS-6983 could receive two full EUMETCast transponders by setting up a system that received 2 x T1 = 2 x (BAS + HVS-1). Before that mighty demonstration (though I always knew) it was very much under dispute and even FUD whether this novel PCIe card from a "Chinese startup" could ever receive both T1 and future T2. I just found that version MVMSG4.cmd as configured by Arne van Belle in an old e-mail. FYI I attach it to this post. MVMSG4.cmd could be used for BAS + HVS-1 + HVS-2 + future HVS-3. And you might be the person that makes it fly. AFAIK there is almost no difference between GNU/Linux and Windows versions of the TC client except for the fact that (impossible under GNU/Linux) Windows can put tmp and received files on different filesystems (partitions) what YOU SHOULD NEVER DO in the first place. Actually I see no reason why you could not run all three Windows clients on a 3-4GB RAM-disk (though I cannot test it here).

Cheers,
Ernst


P.S.
I just tested MVMSG.cmd on my Windows 10 PRO 64Bit desktop. In demo mode it still works as under Windows 7. If you really want to go for it read my documentation first and then send me a PM describing your system. I'll see what I can do.


Re: RamDisk size for HVS-2

Alan Curnow
 

Thanks Ernst for your detailed response.

I've been monitoring my HVS-2 temp files for the last six hours. When first checked there was just one 20MB file there even though it had been working for 12 hours up to that point. Over the next two hours it increased to a maximum of 21 files totalling 4.9GB. It stayed around that figure for an hour or so and then started decreasing in the number of files and memory used to a minimum of 4 files and 850MB after around 5 hours. It's now slowly increasing again.

I notice that none of the existing temp files last update status are more than 2 hours old so it seems all are being written to, and not broken, unless Tellicast is actually deleting them if they haven't been accessed in a certain time. I have a 1.8m dish in SW England and the SR1 reports a Es/No of 17.6dB. In heavy rain it has dropped to 16.9dB. The TBS5927 reports a S/N of 16.4dB and a BER of 0.000000, signal quality of 82 using IPTool v3.0.5.0

It's odd that on your system you never exceed 1.5GB used on the Ramdisk, unless the Windows and Linux versions of Tellicast are different in some way.

Checking the hvs-2 log it does report a missed/incomplete file around avery 10 mins on average.

Cheers,
Alan


Re: RamDisk size for HVS-2

Ernst Lobsiger
 

On Thu, Oct 14, 2021 at 09:31 AM, Alan Curnow wrote:
I can increase the Ramdisk to about 5.5GB but that may not be sufficient. What size Ramdisk does anyone else use for HVS-2 which works OK or am I safer using the SSD.
Alan,

this is an old question I wrote a couple of papers about. The short answer is:

I have several receivers that take BAS + HVS-1 + HVS-2 on one single 3GB RAM-Disk.

I never had a Windows receiver but this can be done on either GNU/Linux or Windows.
One of the main problem is that broken tmp files can stay for hours waiting for
retransmissions that never arrive. So if it seems you have a solution for good
weather the first rain can produce missed packets and then fill up your RAM disk.
I have my own solutions for that but probably nobody uses my Windows MVMSG.cmd.

I asked EUMETSAT long ago to add a CLI switch to the TelliCast client to instantly
delete broken tmp files. This will make handling minimal RAM disks much more easy.
Of course EUMETSAT had to discuss that with NEWTEC that holds all the source code.
According to OPS the next client will now have this (my) switch. Don't hold your breath.


Regards,
Ernst


RamDisk size for HVS-2

Alan Curnow
 

Hello,

I recently installed a second tuner (TBS5927) for HVS-2 (Sentinal OLCI and SLSSTR) to work alongside my SR1 for Basic and HVS-1.

My 500MB ramdisk was fine for Basic and HVS-1 tmp files using only around 50MB of it. I increased it to 4GB but it's still too small for HVS-2 tmp files. I've had to move HVS-2 tmp to an SSD which isn't ideal and it's currently using 4.76GB in 21 files. It seems to need several roughly 15 min bursts of S3A and then S3B data with long pauses between bursts before the tmp files are completed and get automatically deleted.

I can increase the Ramdisk to about 5.5GB but that may not be sufficient. What size Ramdisk does anyone else use for HVS-2 which works OK or am I safer using the SSD.

Cheers,
Alan


Aurora hunters look north

Ernst Lobsiger
 

Hi,

strong Aurora Borealis activity during the last few days over Iceland and the Hudson Bay. Thanks Christian for the heads up.

Cheers,
Ernst


Re: Pytroll/Satpy help on .py file

Daniele Guardigli
 

It works!!! Thank you very much Ernst for your patience


Il giorno lun 11 ott 2021 alle ore 15:53 Ernst Lobsiger via groups.io <ernst.lobsiger=belponline.ch@groups.io> ha scritto:
Daniele,


MSG seviri instrument has these channels:

# Channel | VIS006 |   HRV  | VIS008 | IR_016 | IR_039 | WV_062 |
# WaveLen |  0.635 |   0.7  |   0.81 |   1.64 |   3.90 |   6.25 |
# --------+--------+--------+--------+--------+--------+--------+
# Channel | WV_073 | IR_087 | IR_097 | IR_108 | IR_120 | IR_134 |
# WaveLen |   7.35 |   8.70 |   9.66 |  10.80 |  12.00 |  13.40 |


Satpy composite definition of 'airmass':
...
  airmass:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
    - compositor: !!python/name:satpy.composites.DifferenceCompositor
      prerequisites:
      - wavelength: 6.2
      - wavelength: 7.3
    - compositor: !!python/name:satpy.composites.DifferenceCompositor
      prerequisites:
        - wavelength: 9.7
        - wavelength: 10.8
    - wavelength: 6.2
    standard_name: airmass
...


You need two more 'airmass' lines in your script, put it like below:

...
# We only decompress what is actually needed, see file seviri.yaml
needed_files = {'overview'         : ['VIS006', 'VIS008', 'IR_108'],
                'natural_color'    : ['VIS006', 'VIS008', 'IR_016'],
                'realistic_colors' : ['VIS006', 'VIS008', 'HRV'],
                'hrv_clouds'       : ['IR_108', 'HRV'],
                'night_fog'        : ['IR_039', 'IR_108', 'IR_120', 'IR_134'],
                'airmass'          : ['WV_062', 'WV_073', 'IR_097', 'IR_108'],
                'ir108_3d'         : ['IR_108']}
# Some composite names are too long for IM annotation left of pic
abbreviation = {'overview'         : 'overview',
                'natural_color'    : 'natural_color',
                'realistic_colors' : 'realist_color',
                'hrv_clouds'       : 'hrv_clouds',
                'night_fog'        : 'night_fog',
                'airmass'          : 'airmass',
                'ir108_3d'         : 'ir108_3d'}
...

Then set composite='airmass' and run the script ...


Hope this helps,

Ernst



--
Daniele Guardigli


Re: LaPalma eruption animation using EUMETCast data from EUMETSAT.

Ernst Lobsiger
 

Hi,

the La Palma volcano emitted a Sulfur Dioxide (SO2) plume on October 9th 2021 around 13:15 UTC. While ash shows magenta SO2 rather shows yellow.

http://5.153.116.236:85/images/Test5

Cheers,
Ernst


Re: Pytroll/Satpy help on .py file

Ernst Lobsiger
 

Daniele,


MSG seviri instrument has these channels:

# Channel | VIS006 |   HRV  | VIS008 | IR_016 | IR_039 | WV_062 |
# WaveLen |  0.635 |   0.7  |   0.81 |   1.64 |   3.90 |   6.25 |
# --------+--------+--------+--------+--------+--------+--------+
# Channel | WV_073 | IR_087 | IR_097 | IR_108 | IR_120 | IR_134 |
# WaveLen |   7.35 |   8.70 |   9.66 |  10.80 |  12.00 |  13.40 |


Satpy composite definition of 'airmass':
...
  airmass:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
    - compositor: !!python/name:satpy.composites.DifferenceCompositor
      prerequisites:
      - wavelength: 6.2
      - wavelength: 7.3
    - compositor: !!python/name:satpy.composites.DifferenceCompositor
      prerequisites:
        - wavelength: 9.7
        - wavelength: 10.8
    - wavelength: 6.2
    standard_name: airmass
...


You need two more 'airmass' lines in your script, put it like below:

...
# We only decompress what is actually needed, see file seviri.yaml
needed_files = {'overview'         : ['VIS006', 'VIS008', 'IR_108'],
                'natural_color'    : ['VIS006', 'VIS008', 'IR_016'],
                'realistic_colors' : ['VIS006', 'VIS008', 'HRV'],
                'hrv_clouds'       : ['IR_108', 'HRV'],
                'night_fog'        : ['IR_039', 'IR_108', 'IR_120', 'IR_134'],
                'airmass'          : ['WV_062', 'WV_073', 'IR_097', 'IR_108'],
                'ir108_3d'         : ['IR_108']}
# Some composite names are too long for IM annotation left of pic
abbreviation = {'overview'         : 'overview',
                'natural_color'    : 'natural_color',
                'realistic_colors' : 'realist_color',
                'hrv_clouds'       : 'hrv_clouds',
                'night_fog'        : 'night_fog',
                'airmass'          : 'airmass',
                'ir108_3d'         : 'ir108_3d'}
...

Then set composite='airmass' and run the script ...


Hope this helps,

Ernst


Pytroll/Satpy help on .py file

Daniele Guardigli
 

Hello,

I'm sorry for my ignorance in Python language! Can anyone help me on setting 'airmass' scene on MSG4.py script? Seems it's not available but it's very useful during night and day.

Thank you!

Daniele Guardigli

1141 - 1160 of 33147