Date   

Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Very nice

I assume to get the two jpgs you run two versions of the him8 script  one for true colour and one for natural colour

I have all the scripts working now apart from ones that require Xritdecompress. I guess I'll juts have to wait for those

I finally got my Sentinel 3 scripts working

I did what you suggested and created two separate environments with conda running two different versions of python - very cool

I didnt realise you could do that but it makes life very easy

Thanks again for all your help - I couldnt have got there without it

Kind Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham,

I now installed SAMBA on one of my GNU/Linux receivers and read the data With a Windows 10 PRO
box over the network. I used 7za.exe for decompression and ImageMagick convert as usual. Very
small changes only to make my PyTROLL/Satpy Python Himawari-8 script work with Miniconda3.

Best Regards
Ernst


Re: TBS6902???

Ernst Lobsiger
 

Hendrik

For EUMETCast you need ACM/VCM. Your card only understands CCM.

https://www.tbsdtv.com/products/tbs6902-dvb-s2-dual-tuner-pcie-card.html

Sorry, you will not have success. Do some RTFM on www.eumetsat.int !

Regards
Ernst


TBS6902???

Hendrik Fleming
 

Has anybody had any sucess using the TBS6902 for Eucast? I am a noob upgrading from ARPT and LRPT. Got an old 1.2m dish and are trying to get into Meteocast. The TBS6902 is a about a quarter of the price of the better known, and recommended TBS6903. ( 57€ Vs. 217€)


Re: EUMETCastView v1.3.9

Graham Woolf
 

Hi Simon

I have been running your Sentinel script to process sentinel3 images but have run into a problem

Its these lines

    r=scipy.misc.bytescale(outimg[:,:,0],cmin=rmin,cmax=rmax)
    g=scipy.misc.bytescale(outimg[:,:,1],cmin=gmin,cmax=gmax)
    b=scipy.misc.bytescale(outimg[:,:,2],cmin=bmin,cmax=bmax)

This function is missing from the latest scipy package and I wondered if you know what to replace it with to get the script to work

I have attached the script I have been using

I would love to get this working or if you have a more up to date script would you mind sharing it

Many Thanks

Graham Wool


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Dear Rob
Dear David
Dear Hugo

I'm aware that each of you has managed to integrate xRITDecompress in your EUMETCast software suites.
How selling or distributing of said software packages complies with the special individual License under which
the xRITDecompress source has been distributed by EUMETSAT until very recently I don't know though.

I'm also aware that each of you is certainly capable to provide some xRITDecompress.exe. Hugo might
even be able to compile a native statically linked 64Bit Windows version of xRITDecompress.exe using
some blend of mingw64 as crosscompiler. There is also one single hint on the google pytroll list that
Diego Souza has managed to compile his own version of xRITDecompress.exe (maybe even 64Bit native?).
<cite>
\\xRITDecompress\\xRITDecompress_x64\\xRITDecompress.exe' > > # Create the global scene > global_scene = > Scene(reader='seviri_l1b_hrit',filenames...
</cite>


The point is that EUMETSAT has now silently moved the source code under the Apache License 2.0 and
that therefore such an *.exe decompressor can be distributed under said license with no strings attached.

Let's now wait what EUMETSAT provides or replies. Depending on that we can descide how to go on.

Thank's a lot for your help.


Kind Regards

Ernst


Re: Pytroll/SatPy for EUMETCast

Hugo
 

Hi Ernst,

I didn't knew about the XRITDecompress software that is now open-source. Thanks for the heads-up ; I will change my EUMETCastView accordingly.
It always bothered me that I was not able to include that piece of code in the EUMETCastView package.
Hopefully it will be possible to do the same for the tc-cast-client software ...

Kind regards,

Hugo


Re: Pytroll/SatPy for EUMETCast

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

I have a wavelet decompression DLL compiled with Microsoft Visual C++ which I use in my own software, and might have worked with Pytroll. Nobody asked, though.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Re: Pytroll/SatPy for EUMETCast

R. Alblas
 

Hi, Ernst.

You mentioned in your letter to Eumetsat that compiling xRITDecompress for Windows using cygwin-32-bits is no option, referring to the warnings at the cygwin site.

It sounds to me that, if the 32-bits compiled version runs under Windows-10 64 bits, then that's fine. This software is, as far as I understand, a simple file-in -> file-out functionality without using "fancy" OS-based stuff like 'fork'. My xrit2pic has the wavelet decompression built-in, it's compiled under 32-bits cygwin for Windows, and as far as I know that works fine under 64-bits. Although I am not sure if anyone uses it under Windows-10.

Creating a stand-alone wavelet decompression tool under 32-bits cygwin, running fine under 64-bits Windows OS, seems to me no problem, unless it is a very specific Windows-10 problem. Has anyone ever tried to run it? xrit2pic has a command line mode, which doesn't need all the gtk stuff; that could be called in a script.

Maybe I miss the point somewhere?


Regards,
Rob Alblas




that

On 27-04-2020 22:40, Ernst Lobsiger via groups.io wrote:
Dear All

About a year ago we had a couple of posts about compiling xRITDecompress for Windows 10 64Bit.
This Wavelet Decompressor is still a missing component for Pytroll/Satpy and Meteosat on Windows.
Meanwhile there has taken place a significant change of the licensing conditions. As I understand the
open-source Apache License 2.0 it should now be possible to distribute an xRITDecompress.exe
without registration to everyone. I sent a message to OPS that describes the actual situation and
asked EUMETSAT on behalf of interested amateurs to provide such an xRITDecompress.exe.
FYI I attach a copy of the message below and I will also share EUMETSAT's reaction to that matter.

Best Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Hi Graham

Very nice your Himawari-8 image! I see you begin to unleash the power of Satpy.
And you demonstrate that it can be done under Windows with some try and error
as usual. There is much more to discover ahead. I hope some more Windows
EUMETCast users join now even if they may have to leave their comfort zone.

Best Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Dear All

About a year ago we had a couple of posts about compiling xRITDecompress for Windows 10 64Bit.
This Wavelet Decompressor is still a missing component for Pytroll/Satpy and Meteosat on Windows.
Meanwhile there has taken place a significant change of the licensing conditions. As I understand the
open-source Apache License 2.0 it should now be possible to distribute an xRITDecompress.exe
without registration to everyone. I sent a message to OPS that describes the actual situation and
asked EUMETSAT on behalf of interested amateurs to provide such an xRITDecompress.exe.
FYI I attach a copy of the message below and I will also share EUMETSAT's reaction to that matter.

Best Regards
Ernst


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

This is what fixed it
os.chdir(r"Z:\Images\Him")
cmdstr = "C:/Tools/ImageMagick-7.0.10-Q16/magick convert HIMA8.png  -background White -pointsize 140\
 label:\"\\n Himawari-8 " + Slo + " UTC / received + processed  with GNU/Linux\
 / (c) JMA\\n\" -gravity Center -append " +\
 imgdir + "/" + "Himawari8" + "-" + composite + "-" + Dat + ".jpg"

At last !!!

Kind Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham,

the problem could also be in Python. Try:

cmdstr = "C:\Tools\ImageMagick\convert imgdir + "\" + HIMA8.png -background White -pointsize 140\
 label:\"\\n Himawari-8 " + Slo + " UTC I received + processed  with  Windows 10 I (c) JMA\\n\" -gravity Center -append " +\
 imgdir + "\" + "Himawari8-" + Dat + "-" + composite + ".jpg"

Cheers,
Ernst


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham,

this might be a "/" Linux versus "\" Windows problem. Try this (first and last line changed, no warranty):

cmdstr = "C:\Tools\ImageMagick\convert imgdir + "\" + HIMA8.png -background White -pointsize 140\
 label:\"\\n Himawari-8 " + Slo + " UTC / received + processed  with GNU/Linux\
 / (c) JMA\\n\" -gravity Center -append " +\
 imgdir + "\" + "Himawari8-" + Dat + "-" + composite + ".jpg"

Maybe you should also use the "\" in your imgedir="..." definition (because this is now IM writing there).

Good Luck
Ernst


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

Thanks I have it working now apart from the ImageMagick bit

This is the code

cmdstr = "C:\Tools\ImageMagick\convert imgdir + "/" + HIMA8.png -background White -pointsize 140\
 label:\"\\n Himawari-8 " + Slo + " UTC / received + processed  with GNU/Linux\
 / (c) JMA\\n\" -gravity Center -append " +\
 imgdir + "/" + "Himawari8-" + Dat + "-" + composite + ".jpg"

This is the error

aceback (most recent call last):
  File "T:\PythonScripts\WindowsScripts\hima8.py", line 111, in <module>
    cmdstr = "C:\Tools\ImageMagick\convert imgdir + "/" + HIMA8.png -background White -pointsize 140\
TypeError: unsupported operand type(s) for /: 'str' and 'str'

Its not resolving the correct directory path

I am getting there though and also learning python in the process which is cool

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

Graham

7zip AFAIK decompresses bz2.

https://portableapps.com/apps/utilities/7-zip_portable

I also had a look at IM portable , just unzip

ImageMagick-7.0.10-9-portable-Q16-x64.zip

convert.exe is in there and possibly statically linked.

https://imagemagick.org/script/download.php

I have made no tests though ...

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

Hi Ernst

I have now moved on to the Himiwari data but have a problem with this line

cmdstr="bzip2 -dc "+ files[n] + " > " + files[n][len(cmpdir)+1:-4]

Bzip2 doesnt appear to be supported on Windows

I have done an online search but am struggling to find and code a windows alternative

Do you have any ideas

Regards

Graham
===================================

Graham,

Try:

http://gnuwin32.sourceforge.net/packages/bzip2.htm

I seem to have at least three versions installed by various Linux ports - 2015 (44320 bytes), 2015 (48732 bytes) and 2014 (89618 bytes). The link I found was for a 2008 version (38400 bytes). There's a 2019 version here:

https://github.com/philr/bzip2-windows/releases

I hope you find one which works. I would expect them /all/ to be compatible with basic commands.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv


Re: Pytroll/SatPy for EUMETCast

Ernst Lobsiger
 

David,

<cite>
Python is another example, and I recall Simon Proud showing how a program had to be changed when the Python version was changed. Likely he has more patience than me.
</cite>

The problem Graham has with his older script is a Python problem with an Update not providing a deprecated function after warning for years. No need to complain about GNU/Linux.

Regards,
Ernst


Re: Pytroll/SatPy for EUMETCast

Graham Woolf
 

Hi Ernst

I have now moved on to the Himiwari data but have a problem with this line

       cmdstr="bzip2 -dc "+ files[n] + " > " + files[n][len(cmpdir)+1:-4]

Bzip2 doesnt appear to be supported on Windows

I have done an online search but am struggling to find and code a windows alternative

Do you have any ideas

Regards

Graham


Re: Pytroll/SatPy for EUMETCast

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

Hi David

Unfortunately your script wont work because of the lines

r=scipy.misc.bytescale(outimg[:,:,0],cmin=rmin,cmax=rmax)
g=scipy.misc.bytescale(outimg[:,:,1],cmin=gmin,cmax=gmax)
b=scipy.misc.bytescale(outimg[:,:,2],cmin=bmin,cmax=bmax)

bytescale is no longer part of the scipy package and I dont know how to update it for the latest version

It means therefore that you cant output png files

Regards

Graham
=========================================

Graham,

Ah, well, my script does work, of course! It was only meant as an example of using ImageMagick from the Windows command-line.

Most likely the issue with the script [for you] is the typical Linux problem. Software is typically changed in an arbitrary and unpredictable way by its authors, and it's no longer backwards compatible with earlier versions. I've seen this with the Raspberry Pi operating system, e.g. where the previously available serial port was removed so that Bluetooth software could use it [changes in the boot text were required], in GRC requiring certain versions of support programs (oh, sorry the developer hasn't upgraded /that/ function yet), and in GPSD which seems to be the worst to me. I can no longer recommend GPSD for production use (e.g. as a source for PPS in NTP). Python is another example, and I recall Simon Proud showing how a program had to be changed when the Python version was changed. Likely he has more patience than me.

The multiplicity of distros, shells, GUIs, etc. is one reason why my software wasn't made for Linux.

"Good luck" - as they say!

Cheers,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@...
Twitter: @gm8arv