All you get from MSG4 seviri with PyTROLL/SatPy out of the box
Ernst Lobsiger
Hi All,
here is all possible images you get from three slots of seviri files (most automatically abbreviated composite names, original composite names in filenames). https://we.tl/t-JfzqNvVB7O SatPy 0.35, built in composites only. With above link you get a test.zip of 373 MB (NO typo !!) from "wetransfer". All *.jpg images generated with one script. Cheers, Ernst P.S. The link stays active 1 week starting with the date of this post. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Robert Moore
Very envious Ernst. My engineer has thrown his hand in. All I am getting are incomplete sets of MSG-4 – data enough to create a few VIS and IR images only. Nothing else.
Robert
From: MSG-1@groups.io <MSG-1@groups.io>
On Behalf Of Ernst Lobsiger via groups.io
Sent: 11 June 2022 15:34 To: MSG-1@groups.io Subject: [MSG-1] All you get from MSG4 seviri with PyTROLL/SatPy out of the box
Hi All, |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Robert,
sorry to read about your TelliCast reception problems on this and other lists. I cannot know how professional your engineer really was but read this story: https://groups.io/g/MSG-1/topic/86929967#32153 Even if you cannot climb to your antenna anymore there are a couple of things you can still check with your PC or with simple experiments from the ground nearby. First of all you *must* know whether or not your location (AFAIK northern exposed slope) is as bad as you seem to think. Some of the best tools you can use are: https://www.dishpointer.com/ https://www.dishpointer.eu/ If you are still not sure about a blocking tree/wood simple tools like a spirit level and a card board triangle with your antenna elevation could answer this question. Another approach that just came to my mind is just looking where the sun is at the time of a solar outage (unfortunately spring is over, next outage will be in fall). https://groups.io/g/MSG-1/message/31997 Finally rests the question: What was your best SNR you ever had on your TelliCast receiver and why is it now -- as far as I understand -- very much lower? Regards, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Daniele Guardigli
Really amazing Ernst! Could you share your MSG script, in order to learn how to make composites like night IR with background and others? Thanks, Daniele Il giorno sab 11 giu 2022 alle ore 16:33 Ernst Lobsiger via groups.io <ernst.lobsiger=belponline.ch@groups.io> ha scritto: Hi All, --
Daniele Guardigli |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hi Ernst,
Thanks a lot for this amazing archive! It's very useful because you can see the best composition for a personal project. Your scripts have been a valuable resource for all my setup. I want to share with all of you the website where I upload the images. In a short time, I will provide for a complete re-organization of my page. https://www.wiabruzzo.eu/animation/sat.php Cheers, Samuele Giampietro Chieti, Abruzzo, Italy |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Robert Moore
Many thanks for your thorough reply, Ernst. I don’t think I have any problems with pointing the dish because I am getting some reception (see below) I work with a compass and an accurate inclinometer and having another look at the trees today I thought they’d be very marginal to the dish’s line of sight, but of course the dish was about 2 metres above me, so my measurement is probably subject to some error. Current state of play; I have signal strength of -45 dBm and SNR of 6.2. Previously (before the storm) I had an SNR of 12 to 14. It is a windless day here; I am getting good reception of MSG-4, for the first time. RSS look OK, though Animator doesn’t have all that many files to run on present. Metop-C, in addition to the usual Darmstadt Sounding files there is a big block of AVHR_xx_18 MO3 files but nothing in being processed in Metop Manager. Metop-B GAC data are being processed but I think rather erratically, jumping around the globe and repeating some files. It gets stuck in the Antarctic and then jumps to northern Russia. Again, there are Darmstadt Soundings in the EPS-15 folder, but nothing else.
I’m surprised I’m getting much with this 6.2 SNR but if there is a tall tree close to my line of sight then I’ll lose data once the wind starts blowing. Hope this clarifies a very unclear situation!
Again, thanks,
Robert
From: MSG-1@groups.io <MSG-1@groups.io>
On Behalf Of Ernst Lobsiger via groups.io
Sent: 12 June 2022 11:03 To: MSG-1@groups.io Subject: Re: [MSG-1] All you get from MSG4 seviri with PyTROLL/SatPy out of the box
Robert, |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Robert,
sorry I have to say that for me this clarifies nothing. How can you talk about 12-14dB SNR before the storm and accept 6.5dB SNR now? Unless you have some HF problems (LNB, cable or damaged TelliCast receiver) this is only possible if: a) The storm moved a tree in front of the antenna or b) The storm bent and damaged the antenna or c) The storm simply misaligned your antenna To point a 1m parabolic dish (in azimuth) a compass is worth close to nothing ! It might just help to roughly check the line of sight together with the inclinometer. To point the dish in elevation there should be some scale on the mount. Then point in azimuth using the sun. This has been described a couple of times. Finally you must organize some life display of the SNR of your receiver when fine adjusting. Maybe there is a younger experienced EUMETCast amateur near you that can give you a hand. Best regards, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Robert Moore
Sorry Ernst – I use the compass and inclinometer to check the skyline for obstructions (I only have a very small slot to see the satellite). The lining up of the dish was done by maximising the signal strength. We spent – quite literally – hours, over three days, getting the maximum signal, with the engineer and his meter up the ladder. The position was highly sensitive, a couple of millimetres in azimuth and the signal dropped out altogether. The SNR of 6.2 seemed to me to be absurdly low and I’m amazed that I’m getting any data at all. I have a new 1 metre dish, a new LNB (and a second one when we wondered if the first new one was at fault) and all new cabling. My theory runs as follows: I had been getting perfect reception for some time, the storm damaged my dish and I lost signal, this happened in winter. By the time we tried re-establishing reception the trees had grown by a few critical centimetres and were in leaf, and so the tops of the trees are now in line with the satellite. Thus, had there been no damage to my fully functioning setup I would have lost signal in the Spring anyhow. David’s first question was always ‘What has changed?’ The only change is that the trees have grown. After maximising the signal at 6.2 SNR I thought I was out of satellite reception for good and had turned my equipment off. I turned on again recently in a period of windless weather, expecting to confirm that I was finished. So, I was surprised to find I had _some_ reception, near perfect MSG-4 and RSS. I will wait to see what happens when the wind starts moving the tree-tops again, I suspect the signal will be interrupted. This would confirm my theory and I will, with great regret, dismantle my setup. It would be great to be wrong!
Robert
From: MSG-1@groups.io <MSG-1@groups.io>
On Behalf Of Ernst Lobsiger via groups.io
Sent: 13 June 2022 22:47 To: MSG-1@groups.io Subject: Re: [MSG-1] All you get from MSG4 seviri with PyTROLL/SatPy out of the box
Robert, |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
J.W. Davies
Can I make a comment. On 14/06/22 00:00, Robert Moore wrote:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Robert Moore
Thanks, that’s very helpful. We didn’t really aim at maximising signal strength, once we had found the signal, we just roughly aligned it to a maximum value. Then we concentrated on the SNR, our main problem, and spent most of our time trying to get it above 6. I suspect the ‘radiating leaves’ are playing a leading role in my problems. I always thought the height of the trees was rather marginal, I need a dish elevation of 27.9 degrees, the treetops were around 24 to 26 degrees last summer when I hoped they had reached their mature heights. The odd situation at present is that in spite of losses I currently have MSG-4 HRIT imagery as a level that is useable, providing I don’t need comprehensive 15-minute imagery (and I don’t). RSS is a different story because missing frames make it very unpleasant to watch. I have documented my HRIT signal losses for this morning, X marks ‘no image’:
From 0545 to 0830 I had perfect reception. Looked at my anemometer records, but the wind speed was less than 0.5 m/s and zero between 0415 and 0700 so not much activity in the treetops. Not having direct access to dish and LNB is enormously frustrating. ‘MSG in the woods’ might be getting a bit OT for the MSG-1 list. But I’ll keep you posted! Robert
From: MSG-1@groups.io <MSG-1@groups.io>
On Behalf Of J.W. Davies
Sent: 14 June 2022 10:28 To: MSG-1@groups.io Subject: Re: [MSG-1] All you get from MSG4 seviri with PyTROLL/SatPy out of the box
Can I make a comment.
On 14/06/22 00:00, Robert Moore wrote:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Hi Samuele,
<cite> I want to share with all of you the website where I upload the images. In a short time, I will provide for a complete re-organization of my page. https://www.wiabruzzo.eu/animation/sat.php </cite> It seems you have a huge and interesting project using some of my PyTROLL/SatPy scripts. -- What is the OS you are working with (Windows10 or GNU/Linux or other OS)? -- Do you process the data on your TelliCast receiver PC or on a separate PC? -- Do you decompress all satellite data beforehand or when using my scripts? I'am currently improving my scripts and conrtibuted some PRs to PyCoast and SatPy. The amazing day/night with BlackMarble background composite is partly broken but easy to fix: https://groups.google.com/g/pytroll/c/qjg5zddABA0 https://github.com/pytroll/satpy/pull/2122 I made again 3 zip archives with all possible composites that you get out of the box with SatPy 0.35. I added more meaningful short names for the composites used in the image legends. The full (and sometimes rather long) names of the composites are used in the image file names as usual. You can either look at these composites like at special paintings or you can try to understand what they show from their names and possibly some hints and references in the respective seviri.yaml, abi.yaml, ahi.yaml, visir.yaml composite files and enhancements. https://we.tl/t-kXirDX27Rr MSG4 seviri 202MB https://we.tl/t-UGZSkaLip8 HIMA8 ahi 351MB https://we.tl/t-Y6DuzE0YdZ GOES16 abi 589MB These "wetransfer" links work for everybody and expire one week from now. Not exactly for a 300Baud accusto-coupled telephone modem I started with. Cheers, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Oooops,
that happens if your eyes don't work as the used to. I even wondered why this was so fast. But it seems I'm getting slower as well. I moved a close by icon of a text file I used as a cheat sheet to make my first PyTROLL/SatPy PR (No secret, token expired :-\ ). Here is the real link for the MSG4 seviri zip: https://we.tl/t-K2umbaxVqg MSG4 composites 202MB Regards, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
On Wed, Jun 15, 2022 at 01:13 AM, Ernst Lobsiger wrote:
Hi Samuele,Hi Ernst, About your questions: -- I have two mini PC with Windows 10. For each computers, I've installed the miniconda prompt where I added the pytroll/satpy packages. With the main computer, I receive satellite images and data. Two years ago I mounted a 1.3m diameter dish obtaining a good signal quality. As a capture card, I have a TBS-5925. The computer has 16GB of RAM, AMD Ryzen 7 CPU, 2 SSDs of 1TB capacity installed. With David Taylor's software, I sort all the data, even the raw ones. In addition, I have planned to start the scripts for the orbital satellites with the satpy (NOAA20, EOS-Aqua / Terra, Sentinel-3 *). * Sentinel data is automatically downloaded from Eumetsat's Data Tailor. On the secondary computer, however, the scripts dedicated to the MSG3 / GOES16-17 / MSG4 satellites are scheduled every 5/10/15 minutes. This computer is less powerful than the primary one, as soon as I have economic resources I will update it. The data is decompressed when the scripts start. Your codes have been a great help in setting up a spectacular image processing system. Of course, I made some personal adjustments to suit my needs. Unfortunately, due to lack of time due to university commitments, I am unable to devote much time. However, during the summer break, I will try to make some changes. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Samuele,
a really interesting system. Christian Peters does also decompress all segment files beforehand. I like them compressed as I do everything on my GNU/Linux CLI receivers. What I noticed on your page: -- On the legends of Meteosat images you still note Eumetcast 'Channel_2' (EUMETSAT has renamed Basic Service channels). -- Your Sentinel-3X images have broad fringes at the sides of the swath. That's probably due to a far too big radius_of_influence for the 'nearest' resampler. -- I see that your UKMO mslp overlays are sometimes to old for the underlaying images. I'm in doubt what version of CMD script you use. You probably picked up a (Beta?) script version from this MSG-1 list. There was a last update 2022/01/05 that I faintly remember to have sent to Graham Woolf in a private e-Mail. The problem was a missing [math]::floor as PowerShell *rounds* to next integers (see my logest CMD line ever written). That means the older version was/is buggy because it can round up and cause download problems when it wants to get a future chart. So if your script is basically my older version you should consider to update. I attach the script that I finally found in my Windows mess as a *.txt. Good luck, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
g-woolf@sky.com
Hi Ernst
It wouldnt have been from me - I dont share anything you have sent to me in a private email without your permission Kind Regards Graham |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst,
Thanks for your comment and for all the clarifications. I will, in due course, update the scripts over the weekend. For images with UKMO overlay, I had made some changes in the past. As you said, I had found some resources on the MSG-1 group but, at the same time, I tried to "fix" the CMD myself. Again, many thanks for everything. Cheers, Samuele |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
On Wed, Jun 15, 2022 at 10:55 AM, g-woolf@... wrote:
It wouldnt have been from me - I dont share anything you have sent to me in a private email without your permissionGraham, I didn't suspect or even accuse you to have done anything wrong. IIRC I have written an UKMO mslp chart download and overlay generation CMD script in early 2021 and published this here. Then in late 2021 I worked on 'digitised' UKMO overlays for MeteorGIS with Les Hamilton and had to program a simple mslp chart download CMD script again. I noticed the rounding problem with PowerShell and therefore also updated and sent you the UKMO overlay generation script. So today your name just made me remember that I must/should have a last version of this script somewhere in my Windows mess that I finally/surprisingly found and published above. Up to now you have been the only user I knew of to produce these UKMO overlays with PyTROLL/SatPy under Windows. So when I detected that Samuele does the same thing I was convinced that he had lurked the MSG-1 list for years and has most probably downloaded my faulty version from early 2021. This early version can give wrong names/dates to the resulting overlay *.png files. Best regards, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
Hi All,
Metop has some "hidden" or at least rarely used composites as well: Here is 'green_snow' in Newzeeland (must be winter down there ;-). Cheers, Ernst |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ernst Lobsiger
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
R. Alblas
MSGx.py now accepts all composite types, including 'green_snow'
(or whatever is still hidden or may be added in future). This script contains options for composite and area, so you can
easily make your own "All you get from..." (or 'All I want') for
MSG4 (and/or MSG3, MSG2) using a simple top-level Python script
calling MSGx.py embedded in 'for' loops. See: http://www.alblas.demon.nl/wsat/software/satpy.html (Note: As I already explained, this script is functionally exactly the same as the MSG1...4.py scripts of Ernst; except that options are added for composite, area and more. Without these extra options the script does do exactly the same as MSG1..4.py; defaults are inside the script. Except for time, of course.) Cheers,
On 17-06-2022 16:12, Ernst Lobsiger via
groups.io wrote:
Hi All, |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|