Date
1 - 19 of 19
Data Manager and FY
|
fvalk@...
David,
The MSG Data Manager has the option to save the raw data for use in e.g. another program environment. This has always worked well for all sorts of data but now that I’m trying to re-use the raw data of Feng Yun 2 G&H, I can’t find it anywhere. The GOMS data, that comes in over the same E1B-TPG-1 is saved in my Raw-destination but the FY data not. On the FSD Channel Selection page I do see a specific “keep raw data” setting for Goms, but the CMA data lacks this specificity. Am I doing something wrong from my side or is this the way it presently works. If the latter is the case, would it be possible to extend the saving to FY data as well?
Thanks in advance.
Cheers, Ferdinand |
|
|
|
On 06/09/2022 16:44, fvalk@... wrote:
David,Ferdinand, On that page, there should be a group named "Ch.12 data (CMA)". at the bottom of that group there is a checkbox "Save raw image count". Does that do what you want? I've not tested it recently, though. It's in the PRO version of the software. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
g-woolf@sky.com
HI David I have a Pro version and can confirm that it doesnt work I cant find any FY-2H or FY-2G raw data , only GOMS Kind Regards Graham
On Wednesday, 7 September 2022 at 09:46:00 UTC, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io <david-taylor@...> wrote:
On 06/09/2022 16:44, fvalk@... wrote: > David, > > The MSG Data Manager has the option to save the raw data for use in e.g. > another program environment. This has always worked well for all sorts of data > but now that I’m trying to re-use the raw data of Feng Yun 2 G&H, I can’t find > it anywhere. The GOMS data, that comes in over the same E1B-TPG-1 is saved in > my Raw-destination but the FY data not. On the FSD Channel Selection page I do > see a specific “keep raw data” setting for Goms, but the CMA data lacks this > specificity. > > Am I doing something wrong from my side or is this the way it presently works. > > If the latter is the case, would it be possible to extend the saving to FY data > as well? > > Thanks in advance. > > Cheers, > > Ferdinand Ferdinand, On that page, there should be a group named "Ch.12 data (CMA)". at the bottom of that group there is a checkbox "Save raw image count". Does that do what you want? I've not tested it recently, though. It's in the PRO version of the software. Cheers, David -- SatSignal Software - Quality software for you Email: david-taylor@... Twitter: @gm8arv |
|
|
|
fvalk@...
toggle quoted message
Show quoted text
-----Original Message-----============================== David, Yes, I have that checkbox and I have it active, but nothing of the CMA bulk is being saved in raw. I'm running MDM V3.121.1337. Does having that checkbox available confirm that I'm still using the pro version? Cheers, Ferdinand |
|
|
|
On 07/09/2022 11:26, fvalk@... wrote:
David,Thanks Ferdinand and Graham. Yes, it's not visible (or active) otherwise. I'll investigate further. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
On 07/09/2022 11:26, fvalk@... wrote:
David,Ferdinand, Graham, Yes, that checkbox isn't present in the standard version, and that version only has four "Detailed Images" tabs. I've just checked with the current beta .1337, with current FY2G data (and historic data) and it behaves correctly, saving both images and source .GZ files to the \Images\FSD\yyyy\mm\dd\ directory. Perhaps you were expecting a different directory? Perhaps you might check there? One difference might be that I still use the older directory names - my system passes data thus: [channel] name=E1B-TPG-1 target_directory=Z:\EUMETCast\received\bas\EUMETSAT_Data_Channel_12 but I don't think that should make any difference. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
g-woolf@sky.com
Hi David I dont have that directory This is my setup - see screenshots I dont see any FY2G/H data Kind Regards Graham
On Wednesday, 7 September 2022 at 14:59:13 UTC, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io <david-taylor@...> wrote:
On 07/09/2022 11:26, fvalk@... wrote: > David, > > Yes, I have that checkbox and I have it active, but nothing of the CMA bulk is being saved in raw. > I'm running MDM V3.121.1337. > Does having that checkbox available confirm that I'm still using the pro version? > > Cheers, > Ferdinand Ferdinand, Graham, Yes, that checkbox isn't present in the standard version, and that version only has four "Detailed Images" tabs. I've just checked with the current beta .1337, with current FY2G data (and historic data) and it behaves correctly, saving both images and source .GZ files to the \Images\FSD\yyyy\mm\dd\ directory. Perhaps you were expecting a different directory? Perhaps you might check there? One difference might be that I still use the older directory names - my system passes data thus: [channel] name=E1B-TPG-1 target_directory=Z:\EUMETCast\received\bas\EUMETSAT_Data_Channel_12 but I don't think that should make any difference. Cheers, David -- SatSignal Software - Quality software for you Email: david-taylor@... Twitter: @gm8arv |
|
|
|
On 07/09/2022 16:06, g-woolf@... via groups.io wrote:
Hi DavidGraham, Look in the directory where the FY2G images are stored to see the raw data. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
g-woolf@sky.com
Hi David I have done a search of all my data and cant find any files Can you post an example file name Kind Regards Graham
On Wednesday, 7 September 2022 at 15:20:29 UTC, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io <david-taylor@...> wrote:
On 07/09/2022 16:06, g-woolf@... via groups.io wrote: > Hi David > > I dont have that directory > > This is my setup - see screenshots > > I dont see any FY2G/H data > > Kind Regards > > Graham Graham, Look in the directory where the FY2G images are stored to see the raw data. Cheers, David -- SatSignal Software - Quality software for you Email: david-taylor@... Twitter: @gm8arv |
|
|
|
On 07/09/2022 17:07, g-woolf@... via groups.io wrote:
Hi DavidThis from testing today - both image and raw data in the same directory: 202209071400-fy2c-IR1.png 202209071400-fy2c-IR2.png 202209071400-fy2c-IR4.png 202209071400-fy2c-Vis1km.png Z_SATE_C_BABJ_20220907140000_O_FY2G_FDI_IR1_001_NOM.HDF.gz Z_SATE_C_BABJ_20220907140000_O_FY2G_FDI_IR2_001_NOM.HDF.gz Z_SATE_C_BABJ_20220907140000_O_FY2G_FDI_IR4_001_NOM.HDF.gz Z_SATE_C_BABJ_20220907140000_O_FY2G_FDI_VIS1KM_001_NOM.HDF.gz I'm really puzzled by this! Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
fvalk@...
toggle quoted message
Show quoted text
-----Original Message-----David, Sorry for my delayed response. I have been away from my desk until late and only now saw the messages. I can confirm that indeed the Z_SATE_C_BABJ_xxx....xx_O_FY2H_FDI_IR4_001_NOM.HDF files are present in the image directory (unzipped, as I had that checkbox marked). This solves my puzzle and clarifies why I couldn't find them. For consistency purposes it would be very helpful if the data could be allotted to the Raw Data tree where all else is being directed and which resides (in my case) on a different drive than the images. But only if that doesn't signify extensive additional work for you. Cheers, Ferdinand |
|
|
|
On 07/09/2022 22:14, fvalk@... wrote:
David,Ferdinand, That's excellent news! I hope that Graham has a similar success. Noted on the Raw Data directory. No sure why that's not being used but I can chase that. Would you expect all files to be dumped together, or placed in a yyyy-mm-dd directory tree structure. I'm unsure what the default is for other data. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
fvalk@...
toggle quoted message
Show quoted text
-----Original Message-----============================== David, I currently have the raw data in bulk, without date structure and keep the data volume down by trimming daily. So, bulk is perfectly OK for me. Thanks for looking into this. Cheers, Ferdinand |
|
|
|
g-woolf@sky.com
Hi David Yes it the same for me too I agree with Ferdinand -the Raw Data directory would be good for me too . It keeps things consistent Currently the rest of the Raw Data is placed in a yyyy-mm-dd directory tree structure so if you could make it the same thats great Kind Regards Graham
On Thursday, 8 September 2022 at 06:16:15 UTC, David J Taylor GM8ARV 🏴 🇪🇺 via groups.io <david-taylor@...> wrote:
On 07/09/2022 22:14, fvalk@... wrote: > David, > > Sorry for my delayed response. I have been away from my desk until late and only now saw the messages. I can confirm that indeed the Z_SATE_C_BABJ_xxx....xx_O_FY2H_FDI_IR4_001_NOM.HDF files are present in the image directory (unzipped, as I had that checkbox marked). > > This solves my puzzle and clarifies why I couldn't find them. For consistency purposes it would be very helpful if the data could be allotted to the Raw Data tree where all else is being directed and which resides (in my case) on a different drive than the images. But only if that doesn't signify extensive additional work for you. > > Cheers, > Ferdinand Ferdinand, That's excellent news! I hope that Graham has a similar success. Noted on the Raw Data directory. No sure why that's not being used but I can chase that. Would you expect all files to be dumped together, or placed in a yyyy-mm-dd directory tree structure. I'm unsure what the default is for other data. Cheers, David -- SatSignal Software - Quality software for you Email: david-taylor@... Twitter: @gm8arv |
|
|
|
fvalk@...
//snip
============================================================= Just to add: as far as I know, the raw saving follows the general 'file options' setting on the Options page of the settings. 'Dates in folders' applies to both image and raw. |
|
|
|
Ferdinand, Graham,
There's a beta 1338 just uploaded. https://www.satsignal.eu/software/beta.htm This saves the data - as received - in the Raw Data directory, and does not save in the Image tree. The change means that the option to save the uncompressed data cannot be honoured as, just like other data, this is simply a direct copy of the source. I don't know whether there will be any implications for the CMA meteorological data. On my system the raw data is in a yyyy\mm\dd directory tree. Please test and report. Thanks, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
|
fvalk@...
toggle quoted message
Show quoted text
-----Original Message-----=================== David, Downloaded and implemented. The data comes in into the RawData directory just as you described. This is valid both for bulk configuration and for yyyy\mm\dd directory tree. I have not seen anything odd in the CMA meteorological data thus far. Thanks for accommodating my request. Cheers, Ferdinand |
|
|
|
fvalk@...
toggle quoted message
Show quoted text
-----Original Message-----================================= David, Just to confirm. The changes in the MSG Data Manager did not influence the CMA meteorological data saving behaviour. Version 1338 works well for both the new raw data saving location and the old CMA met data. Cheers, Ferdinand |
|
|
|
On 09/09/2022 07:09, fvalk@... wrote:
David,Thanks for letting me know, Ferdinand. Glad it's working. Cheers, David -- SatSignal Software - Quality software for you Web: https://www.satsignal.eu Email: david-taylor@... Twitter: @gm8arv |
|
|
