Date   

Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Hi John,

to skip the PaintShop pro part, put this in your personal enhancements/generic.yaml:

  night_test:
    standard_name: night_test
    operations:
      - name: inverse
        method: *inversefun
        args: [true]
      - name: stretch
        method: *stretchfun
        kwargs:
          stretch: linear

Then the inversion is done by the enhancement and you don’t have to do it in PaintShop.

Regards,

Christian 




Am 17.11.2020 um 17:19 schrieb john.haslam4 via groups.io <john.haslam4@...>:

This inspired me to create a composite night_test  which uses M12 Blue, M14 Green and M15 Red

night_test:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
    - M15
    - M14
    - M12
    standard_name: night_test

The cold cloud tops come out dark so I inverted the image in Paint Shop to get a result similar to using Hugo's EUMETCASTView for these channels


Re: Pytroll/SatPy for EUMETCast

john.haslam4@...
 

This inspired me to create a composite night_test  which uses M12 Blue, M14 Green and M15 Red

night_test:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
    - M15
    - M14
    - M12
    standard_name: night_test

The cold cloud tops come out dark so I inverted the image in Paint Shop to get a result similar to using Hugo's EUMETCASTView for these channels


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Thanks Ernst, good gardening!

Winter?  Something long forgotten here.....

 

From: MSG-1@groups.io On Behalf Of Ernst Lobsiger via groups.io
Sent: Monday, 16 November, 2020 12:49
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Ferdinand,

I'am really a scientist but I have worked as a teacher most of the time.
Therefore it's nice to see you arrived at chapter 8.) of my text already:

8) Where do we go from here
-------------------------------------
...
What composites need what instrument channels? Find answers here:
C:\users\username\miniconda3\envs\pytroll\Lib\site-packages\satpy\etc\composites
...
For almost every RGB composite there are interesting short "Guides" like the one I attached.
You find them all in directory "Guides" of Diego Souzas SHOWCast program suite which under
the hood actually uses Pytroll/Satpy for image processing. You find SHOWCast here:

https://geonetcast.wordpress.com/2020/07/08/new-showcast-release-v-2-0-0/

My 2.0 version is still on the TODO list. I have to ready my garden (jungle) for the looming winter.

Best regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Ferdinand,

I'am really a scientist but I have worked as a teacher most of the time.
Therefore it's nice to see you arrived at chapter 8.) of my text already:

8) Where do we go from here
-------------------------------------
...
What composites need what instrument channels? Find answers here:
C:\users\username\miniconda3\envs\pytroll\Lib\site-packages\satpy\etc\composites
...
For almost every RGB composite there are interesting short "Guides" like the one I attached.
You find them all in directory "Guides" of Diego Souzas SHOWCast program suite which under
the hood actually uses Pytroll/Satpy for image processing. You find SHOWCast here:

https://geonetcast.wordpress.com/2020/07/08/new-showcast-release-v-2-0-0/

My 2.0 version is still on the TODO list. I have to ready my garden (jungle) for the looming winter.

Best regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Ernst,

 

If you are planning to release a version 2 of the HOWTO for Windows you may consider to include the attached file, which contains the various channel combinations to produce composites for the Goes satellites. It can be inserted in your goes16.py and goes17.py scripts and works for both full disk and field-of-view defined region.

 

Cheers,

Ferdinand


Re: FY-3D.

Ernst Lobsiger
 

On Wed, Nov 11, 2020 at 06:30 AM, <john.haslam4@...> wrote:
I have replied to this confirming that I no longer see missing data.
John and All

I just made mosaics from different passes (area Westminster) and  single passes over London (area eurol) for FY-3D, NOAA-20 and Suomi-NPP and
for the last fife days Nov. 07..11 . All in all this is 30 images from maybe 100 orbits ant tousands of segments. I have not found a single segment missing.

I got the same e-mal from OPS as John and will report my findings. I add two NOAA-20 thumbnails of my 30 images. The problem seems to be resolved.

Cheers,
Ernst


Re: FY-3D.

john.haslam4@...
 

I have received this from OPS

Dear John,

We would like to apologise for the delay in getting back to you regarding the missing segments.

Our experts continue monitoring the data but they have seen an improvement in the situation since the 1st November. Could you please confirm this is also the case for you?

 

Best regards,

 

Maria

I have replied to this confirming that I no longer see missing data.
PS Have now got Python working for GOES16/17 FY-3D SUOMI NPP and NOAA 20. Thanks very much to Ernst for the starter kit.
I am a beginner to Python but have now got well past print("Hello World")

All the best 

John

 

 

EUMETSAT User Service


Re: RX 2 wanted

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

From: Allan Sloan via groups.io

Gents,

Just getting back into satellite reception during lock down and getting some good results with QFH and Double Cross Antenna that I have built recently

What I am looking for is a second RX2 as I am looking to get my daughter to receive some NOAA passes when see is in Norway as part of her Phd

looking to try a Raspberry PI to keep weight down or I might look at SSD radio

So what I am looking for At present is a working or broken RX2 radio that is surplus to your requirements that is gathering dust in a cupboard

If you have one drop me a email.
====================================================

Allan,

These days, a Raspberry Pi with free software and a low-cost USB dongle will do the job nicely:

https://www.instructables.com/Raspberry-Pi-NOAA-Weather-Satellite-Receiver/

https://shop.technofix.uk/super-stable-1ppm-tcxo-r820t2-tuner-rtl2832u-rtl-sdr-usb-stick-version-3

She will learn a lot from having an RPi. There's one built inside a keyboard just out:

https://www.raspberrypi.org/products/raspberry-pi-400/?resellerType=home

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


RX 2 wanted

Allan Sloan
 

Gents,

Just getting back into satellite reception during lock down and getting some good results with QFH and Double Cross Antenna that I have built recently

What I am looking for is a second RX2 as I am looking to get my daughter to receive some NOAA passes when see is in Norway as part of her Phd

looking to try a Raspberry PI to keep weight down or I might look at SSD radio

So what I am looking for At present is a working or broken RX2 radio that is surplus to your requirements that is gathering dust in a cupboard

If you have one drop me a email.


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Thanks Ernst, your support is very much appreciated. I’m enjoying this avenue into the (for me) rather fresh territory of PyTroll/Satpy at 73 think it is good to join the ranks of the old farts club.

 

Cheers,

Ferdinand

 

From: MSG-1@groups.io On Behalf Of Ernst Lobsiger via groups.io
Sent: Sunday, 08 November, 2020 19:35
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

On Sun, Nov 8, 2020 at 11:10 AM, Ferdinand Valk wrote:

Noaa_20:                          segdir = "F:/MSG/Images/VIIRS" + "/" + Yea + "/" + Mon + "/" + Day

Suomi_NPP:                     segdir = "J:/EUMETCast/received/hvs-1/E1H-RDS-1" + "/"

 

So it seems that the end of the second line should exclude the last “/”. That would indeed explain exactly what you indicated. Syntax issue.

Ferdinand,

I always use directories without a final "/". The line "files = glob(segdir + "/" + SVMC_npp_d ....*.h5) actually got a "//" but it seems glob()
-- that is similar to "dir" in Windows or "ls"  under GNU/Linux -- did its job anyway but returned the path and filenames with one "/" only!
But as explained offset was and remained 1 too much. What you did is "learning by doing" and that's what PyTROLL/Satpy is all about ...

Cheers,
Ernst



Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

On Sun, Nov 8, 2020 at 11:10 AM, Ferdinand Valk wrote:

Noaa_20:                          segdir = "F:/MSG/Images/VIIRS" + "/" + Yea + "/" + Mon + "/" + Day

Suomi_NPP:                     segdir = "J:/EUMETCast/received/hvs-1/E1H-RDS-1" + "/"

 

So it seems that the end of the second line should exclude the last “/”. That would indeed explain exactly what you indicated. Syntax issue.

Ferdinand,

I always use directories without a final "/". The line "files = glob(segdir + "/" + SVMC_npp_d ....*.h5) actually got a "//" but it seems glob()
-- that is similar to "dir" in Windows or "ls"  under GNU/Linux -- did its job anyway but returned the path and filenames with one "/" only!
But as explained offset was and remained 1 too much. What you did is "learning by doing" and that's what PyTROLL/Satpy is all about ...

Cheers,
Ernst




Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Ernst,

 

The entries are here below. Noaa is in a date tree directory and Suomi in a bulk directory.

 

Noaa_20:                          segdir = "F:/MSG/Images/VIIRS" + "/" + Yea + "/" + Mon + "/" + Day

Suomi_NPP:                     segdir = "J:/EUMETCast/received/hvs-1/E1H-RDS-1" + "/"

 

So it seems that the end of the second line should exclude the last “/”. That would indeed explain exactly what you indicated. Syntax issue.

 

Thanks for your help.

 

Ferdinand

 

Ferdinand,

good to hear you dit it! The only explanation I have and already thought of before is that you have an extra / in the definition of the segment directory
or that you use special UTF8 characters in these channel names that are counted as two bytes or something similar. This could do something with
the definition "offset = len(segdir)+1". Can you publish on this list the entries of "segdir = ..." you use in both scripts Noaa_20 and Suomi_NPP ?

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

On Sun, Nov 8, 2020 at 09:38 AM, Ferdinand Valk wrote:

I got it working but am no closer to understanding.

 

Cheers,

Ferdinand

 

Ferdinand,

good to hear you dit it! The only explanation I have and already thought of before is that you have an extra / in the definition of the segment directory
or that you use special UTF8 characters in these channel names that are counted as two bytes or something similar. This could do something with
the definition "offset = len(segdir)+1". Can you publish on this list the entries of "segdir = ..." you use in both scripts Noaa_20 and Suomi_NPP ?

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ferdinand Valk
 

Ernst,

 

From the values shown in the debugging you proposed I could deduce that in the case of Suomi-NPP files the filename was interpreted incorrectly. In order for the script to work the offset should be one less than I had and read:

...
    Hou = files[n][offset+19:offset+21]
    Min = files[n][offset+21:offset+23]
    Sec = files[n][offset+23:offset+25]

With these values the script runs flawlessly.

 

This leaves me with a big question mark. If I look at the filenames of NOAA-20 and Suomi-NPP respectively (example files)

SVMC_j01_d20201108_t0540186_e0541413_b15406_c20201108055320000528_eum_ops

SVMC_npp_d20201105_t1349300_e1350541_b46765_c20201105140237000455_eum_ops

the offset should be the same in both cases, as the hou, min, sec appear at the same index in the name, but still the NOAA script runs at 20, 22 and 24, whereas Suomi at 19, 21 and 23.

 

I got it working but am no closer to understanding.

 

Cheers,

Ferdinand

 

 

From: MSG-1@groups.io On Behalf Of Ernst Lobsiger via groups.io
Sent: Friday, 06 November, 2020 15:53
To: MSG-1@groups.io
Subject: Re: [MSG-1] Pytroll/SatPy for EUMETCast

 

Ferdinand

The line probably refers to:

        dt = datetime(int(Yea), int(Mon), int(Day), int(Hou), int(Min),
                      int(Sec)) + timedelta(seconds = 43)

Which is actually

        dt = datetime(int(Yea), int(Mon), int(Day), int(Hou), int(Min), int(Sec)) + timedelta(seconds = 43)

if written on one line.

The claim is that Sec is not in range 0..59  which means it's not properly taken from a filename
(or the above line is damaged somehow?). You can try to debug it the old way using print ():

...
    Hou = files[n][offset+20:offset+22]
    Min = files[n][offset+22:offset+24]
    Sec = files[n][offset+24:offset+26]
    print ("-------->", Hou, Min, Sec)
...
You can also try to print the filelist files if you see different behaviour on different days.
...
# Glob by date, assume that interesting segments are all after midnigt
files = glob(segdir + "/" + "SVMC_npp_d" + Yea + Mon + Day + "*.h5")
print ("-------->", files)


Or you can attach the script and the printed files to your reply if you cannot nail it down.

Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Graham,

it’s not just a script, I had to do custom composites, enhancements, adding a custom area definition, the colorbar file etc.
This is not provided in Pytroll as they don’t distribute the big background tiff files. Therefore this composites are not build in.

Maybe you should start with GeoSatSignal as it’s a lot more easy to get those images.

If Ernst will provide a V2 version of his Pytroll Win packet maybe I can provide some of these composites to implement them in his packet.

Regards,

Christian

Am 08.11.2020 um 12:52 schrieb David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺 via groups.io <david-taylor=blueyonder.co.uk@groups.io>:

i Christian

Wow - I love those images

Is it possible for you to send me the code you use to get those images so that I can try it in my files

Regards

Graham
===========================

You should also be able to make similar images with GeoSatSignal, of course, using background mode.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv





Re: TBS 6903 Signal Display

diogenes1@...
 

Hello John and thanks to those who responded to my problem. Setting up dishes is certainly my bête noire, you may remember a little while ago when I raised the topic of aligning my 1.5m dish - I never did achieve that. I live in a difficult location for satellites, a river valley with hills on both sides and trees as a further complication. I have both HVS streams on the TBS 6903 and on a seperate pc the SR1 used for the basic service. I use AeroAdmin between pcs and laptop so I will try using SR1 Control instead, at least I will be able to see the larger dials!
Regards, Peter


Nov 8, 2020, 12:21 by geojohnt@...:

Alan and Peter,

I agree with Alan 'you' really need to see 'a meter' at the dish when you are adjusting it.

I use TeamViewer between my computer and mobile phone.
Using an SR1 for EUMETCast I can relay the three SR1 readout dials enlarged on the phone screen.

Beware Peter, if my dish is not aligned to 10 A but a same frequency and polarisation transponder on another satellite, the meter will indicate good SNR and Power - but no data present on the Traffic dial.
So it is easy to be mislead(?) by a close-by satellite.

Eutelsat 9 B does not have a transponder on EUMETCast TP 1 so that is not a problem.
Mind you, if your dish was aligned to 9 B you are almost there anyway.

So, if the TBS setup window also shows data flow then that is an aid.

Regards,
John.

++++++++++++++++++++



-----Original Message-----
From: Alan Sewards <alan@...>
To: MSG-1@groups.io
Sent: Fri, 6 Nov 2020 17:58
Subject: Re: [MSG-1] TBS 6903 Signal Display


Hi folks,
    I use the TBS software and have for many years with no problems. To line up dishes, use the value shown for SNR in the boxes under the two-line coloured display. This responds in a most sensitive manner to antenna movements. BUT you have to be able to see the value shown as you adjust the dish. It is almost impossible to do with someone repeating the value over a phone or listening to the voiceover spoken by the card. The line showing Quality also responds but is almost full-screen and small changes are not easy to see and impossible to report!.
Signal strength is mainly noise from the amplifiers and does not respond to signal to noise ratio. If the interfering transponder with the transponder carrying the basic service is on,, my SNR is about 11.4dB, if it is off (rare!) it goes up to 13.6 dB. in other words, when off, I can receive HVS, when on, I am limited to the basic service.This just about matches well with calculations.
Best of luck!
Alan S
On 06-Nov-20 12:59 PM, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io wrote:
Hello all, I am trying, once more, to set up my dish and I am using the signal strength indicator in the TBS control panel. The level sits at 49% and then suddenly jumps up to 98% sits there for a while then moves back down again. I am monitoring two seperate connections from the lnb to the card and both move in unison. I have tried a different lnb with similar results. Does anyone know quite what the card is measuring when it says signal strength? Will this include noise or is it the pure satellite signal?
Regards, Peter
================================

Peter,

The TBS software never worked properly for me.  Try using BDADataEx instead (you can likely still use the TBS afterwards).  If the TBS reports dB rather then some meaningless percentage, use that.  Remember it the best SNR you need, not necessarily the strongest signal.  Maybe "quality" in TBS-speak?

Cheers,
David




Avast logo
This email has been checked for viruses by Avast antivirus software.



Re: TBS 6903 Signal Display

geojohnt@...
 

Alan and Peter,

I agree with Alan 'you' really need to see 'a meter' at the dish when you are adjusting it.

I use TeamViewer between my computer and mobile phone.
Using an SR1 for EUMETCast I can relay the three SR1 readout dials enlarged on the phone screen.

Beware Peter, if my dish is not aligned to 10 A but a same frequency and polarisation transponder on another satellite, the meter will indicate good SNR and Power - but no data present on the Traffic dial.
So it is easy to be mislead(?) by a close-by satellite.

Eutelsat 9 B does not have a transponder on EUMETCast TP 1 so that is not a problem.
Mind you, if your dish was aligned to 9 B you are almost there anyway.

So, if the TBS setup window also shows data flow then that is an aid.

Regards,
John.

++++++++++++++++++++


-----Original Message-----
From: Alan Sewards <alan@...>
To: MSG-1@groups.io
Sent: Fri, 6 Nov 2020 17:58
Subject: Re: [MSG-1] TBS 6903 Signal Display

Hi folks,
    I use the TBS software and have for many years with no problems. To line up dishes, use the value shown for SNR in the boxes under the two-line coloured display. This responds in a most sensitive manner to antenna movements. BUT you have to be able to see the value shown as you adjust the dish. It is almost impossible to do with someone repeating the value over a phone or listening to the voiceover spoken by the card. The line showing Quality also responds but is almost full-screen and small changes are not easy to see and impossible to report!.
Signal strength is mainly noise from the amplifiers and does not respond to signal to noise ratio. If the interfering transponder with the transponder carrying the basic service is on,, my SNR is about 11.4dB, if it is off (rare!) it goes up to 13.6 dB. in other words, when off, I can receive HVS, when on, I am limited to the basic service.This just about matches well with calculations.
Best of luck!
Alan S
On 06-Nov-20 12:59 PM, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io wrote:
Hello all, I am trying, once more, to set up my dish and I am using the signal strength indicator in the TBS control panel. The level sits at 49% and then suddenly jumps up to 98% sits there for a while then moves back down again. I am monitoring two seperate connections from the lnb to the card and both move in unison. I have tried a different lnb with similar results. Does anyone know quite what the card is measuring when it says signal strength? Will this include noise or is it the pure satellite signal?
Regards, Peter
================================

Peter,

The TBS software never worked properly for me.  Try using BDADataEx instead (you can likely still use the TBS afterwards).  If the TBS reports dB rather then some meaningless percentage, use that.  Remember it the best SNR you need, not necessarily the strongest signal.  Maybe "quality" in TBS-speak?

Cheers,
David



Avast logo
This email has been checked for viruses by Avast antivirus software.
www.avast.com


Re: Pytroll/SatPy for EUMETCast

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

i Christian

Wow - I love those images

Is it possible for you to send me the code you use to get those images so that I can try it in my files

Regards

Graham
===========================

You should also be able to make similar images with GeoSatSignal, of course, using background mode.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: https://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Christian

Wow - I love those images

Is it possible for you to send me the code you use to get those images so that I can try it in my files

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Christian Peters
 

Hi Graham,

yes it’s not as simple, but you can do things like that.

Regards,

Christian 



Am 08.11.2020 um 11:07 schrieb Graham Woolf <woolfg@...>:

Hi Ernst

Thanks - I'll have a read of that

Obviously not a simple as I first thought

Regards

Graham

1181 - 1200 of 31375