Date   

Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

I used the Isle of Man

What should I use I am near Bournemouth on the south coast - do I just use my lat/long

I am using python version 3.7.3 in Anaconda

Regards

Graham


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

There is an additional problem with your coast lines. The error file states:

  File "T:\Anaconda\lib\site-packages\shapefile.py", line 646, in load
    raise ShapefileException("Unable to open %s.dbf or %s.shp." % (shapeName, shapeName))
shapefile.ShapefileException: Unable to open C:\Tools\gshhs\GSHHS_shp\i\GSHHS_i_L1.dbf or C:\Tools\gshhs\GSHHS_shp\i\GSHHS_i_L1.shp.
Did you use the coast lines from EUMETCastView? If so this does not work as Hugo uses the bin coastline files
but you need the shape files (*.shp and *.dbf). You must unzip into the coastline directory  gshhg-shp-2.3.7.zip
There will be subdirs GSHHS_shp and WDBII_shp and some text files. See explanation in my HOWTO.

Cheers,
Ernst


Re: FY3D EARS Data

Ernst Lobsiger
 

On Fri, Apr 24, 2020 at 11:34 AM, Ernst Lobsiger wrote:
Graham,


SVMC_npp_d20200423_t1327058_e1328300_b43984_c20200423133755000773_eum_ops.h5'
1 segment missing
SVMC_npp_d20200423_t1329567_e1331208_b43984_c20200423134301000243_eum_ops.h5'
4 segments missing
SVMC_npp_d20200423_t1335383_e1337024_b43984_c20200423134606000218_eum_ops.h5'


Graham,

Correction: 3 VIIRS segments missing in the second gap (not 4 as stated before).

@David I already made Q&D the changes and the script FY-3D_VIS.py runs with FY-3D data
(see images). Of course the comment part of the script has to be changed for FY-3D yet ...

Cheers,
Ernst


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

From your error.txt it seems you only provided these 3 segment files

SVMC_npp_d20200423_t1327058_e1328300_b43984_c20200423133755000773_eum_ops.h5'
1 segment missing
SVMC_npp_d20200423_t1329567_e1331208_b43984_c20200423134301000243_eum_ops.h5'
4 segments missing
SVMC_npp_d20200423_t1335383_e1337024_b43984_c20200423134606000218_eum_ops.h5'

One Suomi_NPP VIIRS segment lasts app. 86 seconds. Start times start at offset 20 of file names.
Do you provide a recent tle-file? If not you may test tlefile = " " (loads every time from INTERNET).

Cheers,
Ernst


Re: FY3D EARS Data

David J Taylor GM8ARV 🏴󠁧󠁢󠁳󠁣󠁴󠁿 🇪🇺
 

Hi Ernst

Progress of sorts

I have attached an error log and an image file

What do you think - the image doesnt quite look like yours - mine still has the black lines

Attachments:


errors.txt
Suomi_PPP-Orbit_43983-DayTime-20200423-true_color-swath.jpg
=================================

Graham,

I have a program to removed the objectionable unpopulated bands at the edge of the image.

https://www.satsignal.eu/software/DefragNPP.html

Once you get a complete image let me have a copy and I'll see whether the program may be adapted to suit FY-3D data.

Cheers,
David
--
SatSignal Software - Quality software for you
Web: http://www.satsignal.eu
Email: david-taylor@blueyonder.co.uk
Twitter: @gm8arv


Re: FY3D EARS Data

Ernst Lobsiger
 

Gaham,

The black lines is VIIRS specific. This saves bandwith as the raw scan lines in
this region would overlap. You can see this in EUMETCastView as well as
long as you do not resample the raw data to some map projection.

What antenna position did you use? It seems that you are missing segments?
Maybe you should begin with the swath image only and comment out the two
projected images in the script. You can also print out the bestfiles found
by uncommenting the last two lines. What Pyton version do you use?

Regards
Ernst
.


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

Progress of sorts

I have attached an error log and an image file

What do you think - the image doesnt quite look like yours - mine still has the black lines


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

I have tried running one of your scripts and get the following error

:\>T:\Anaconda\python.exe  T:\PythonScripts\Suomi_NPP_VIS.py 20200423

ERROR 4: Unable to open EPSG support file gcs.csv.  Try setting the GDAL_DATA environment variable to point to the directory containing EPSG csv files.

Any idea what this means

Kind Regards

Graham


Re: Ayecka SR1 in 2020

stevens312
 

Michele, Hi David is correct regarding Tuners but TBS now has an advanced version TBS-6903x, this has a much-improved Chip and performs extremely well in all conditions, and can take all transponders.
Regards to all, Mike G4CFZ


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

that's no Voodoo just simple spherical trigonometry. I have organized the data
in a ... /TC-CHANNEL/YEAR/MON/DAY structure as used by EUMETCastView.

You call the script (after installing PyTROLL/Satpy and acivating it's env) with:

(YOUR ENV) python MyScript.py 20200423

The script makes a list of files available for the day. Then it extracts the
UTC stamps of the segments and calculates the sat position in the middle
of the segment. If its close enough to your POI (antenna?) the file name
is added to a goodlist. The closest segment will define the orbit for a
bestlist. This bestlist of files is finally read and treated by SatPy.

Regards,
Ernst


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

Thanks for that - very useful

I am assuming that your scripts are called with one parameter ie. the date

# Date YYYYMMDD
Dat=sys.argv[1]

as here

I am then assuming your script searches all the relevant files for the current day but Im not clear how it picks the relevant file

Kind Regards

Graham


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

Yes it's defined there (not good programming :-). Today I installed miniconda3
and PyTROLL/SatPy on my Windows 10 box. I "translated" two scripts. There
was a minor problem with UNIX timestamps. I attach the two scripts and results.

The FY-3D_VIS is a *very* QUICK and DIRTY adaption of Suomi_NPP_VIS!
Just to give you a first idea. If some more Windows users are interested, we
could do some (corona) home schooling. But as I have no clue how average
Windows TC receivers are organized, maybe Thorsten would be needed too.
Hugo could eventually give us a hand with the wavelet decompression stuff.


Cheers,
Ernst


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

Yes I am running Windows 10 and I have Anaconda installed for the processing of Sentinel 3 data
 
The unzipping etc is not a problem - I have the scripts OK

The biggest problem for me is how to translate the unix in your scripts to Windows

So my first question is where does coast_dir get set or is it defined in this statement 

                      overlay = {'coast_dir': '/home/lobsiger/gshhg-shp/',

Regards

Graham


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

as you know I mostly run GNU/Linux. When I wrote my SatPy HOWTO I had one
Windows 7 PC as well. If you are on Windows it's certainly Windows 10 now.
I just checked with a recent Windows 10 install how to give it a go:

A *.tgz is a *.tar archive that is gzipped. In Windows 10 you can:

- use 7zip to gunzip and untar my HOWTO.tgz in two steps
- directly use the EDITOR for extracted *.txt and *.py files

The Windows 10 EDITOR understands UTF8 and missig CRs from GNU/Linux.
You will need an ANACONDA Python (take the latest 3.7 version) environment.

Hope this helps
Ernst


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

I wouldnt say familiar exactly although I have manages to get Sentinel data decoded

I will have a go

Thanks

Graham


Re: FY3D EARS Data

Ernst Lobsiger
 

Graham,

are you familiar with PyTroll/SatPy? If not read my HOWTO attached to message #28324 4/13/19
or just search the list for "SatPy HOWTO". The script Christian used for FY3D is basically what
you find within the HOWTO-tgz for Metop A,B,C, Aqua, Terra, NOAA-20, Suomi_NPP. If you
are on WINDOWS you need a program to decompress my *.tgz first and then add the CRs by
opening and saving the text files with WORDPAD. Then use the EDITOR. SatPy lets you reproject
in whatever map projection you can think of! Feel free to ask if you run into any kind of problems.

Best Regards,
Ernst


Re: FY3D EARS Data

Graham Woolf
 

Hi Ernst

can you possible attach your script or email a link

I would like to be able to decode this data

Kind Regards

Graham


Re: FY3D EARS Data

Christian Peters
 

Ernst,

yes...I do resampling. But you are right, works without the files and no resampling too.
Just using different versions of Satpy (14, 18 an 21) because of different environments! :-D But I stay on Python 3.7 version as there are still some issues with 3.8. and some progs.
But the most recent version V0.21.0 should work. Maybe you have to do some updates or start a new env with this version to get thing working....

Regards,

Christian


Am 22.04.20 um 15:57 schrieb Ernst Lobsiger via groups.io:

Christian,

that's really good looking. Yes my over-head-SatPy script should work for most sun synchronous satellites.
Of course the GEO location file is used for resampling. I didn't think of that because my "convert" script
for OLCI pictures does no resampling. I just restarted my TC receivers. What SatPy version do you use?

Cheers,
Ernst


Re: FY3D EARS Data

Douglas Deans
 

On 22/04/2020 14:39, Christian Peters via groups.io wrote:
Ernst and Douglas,
success! We need the GEO files in Satpy for geolocation information.
Sadly it's only the 1km resolution version which is distributed....! :-(
But it works nice with your modified script Ernst, see .jpgs (raw and with correction)! :-)
Regards,
Christian
===================================================================

Very nice Christian.
However for non programming people this method is completely out of their comfort zone.

Regards,
Douglas.


Re: FY3D EARS Data

Ernst Lobsiger
 

Christian,

that's really good looking. Yes my over-head-SatPy script should work for most sun synchronous satellites.
Of course the GEO location file is used for resampling. I didn't think of that because my "convert" script
for OLCI pictures does no resampling. I just restarted my TC receivers. What SatPy version do you use?

Cheers,
Ernst

2401 - 2800 of 31630