|
Re: Tile Set Flushing
#poll
Greg Depew
I use it after I have done an edit to OSM to make sure it went through.
Greg KB3KBR Sent from my Verizon, Samsung Galaxy smartphone
-------- Original message --------
From: Lynn Deffenbaugh <kj4erj@...>
Date: 5/14/20 15:17 (GMT-05:00)
To: APRSISCE@groups.io
Subject: Re: [APRSISCE] Tile Set Flushing #poll
No, I guess I'm after those that use it for "real". And there are positive answers already! Cool.
Lynn (D) - KJ4ERJ - Author of APRSISCE/32/MO/...
|
||||||||||
|
|
||||||||||
|
Re: Tile Set Flushing
#poll
Lynn Deffenbaugh
No, I guess I'm after those that use it for "real". And there are positive answers already! Cool.
Lynn (D) - KJ4ERJ - Author of APRSISCE/32/MO/...
|
||||||||||
|
|
||||||||||
|
Re: Tile Set Flushing
#poll
Rob Giuliano
Does testing count? Robert Giuliano
On Thursday, May 14, 2020, 2:01:13 PM EDT, Lynn Deffenbaugh <kj4erj@...> wrote:
A new poll has been created: Have you ever used the "Flush" button on a Map Tile Set?
1. Nope, never Do not reply to this message to vote in the poll. You can vote in polls only through the group's website.
|
||||||||||
|
|
||||||||||
|
Tile Set Flushing
#poll
Lynn Deffenbaugh
Have you ever used the "Flush" button on a Map Tile Set?
|
||||||||||
|
|
||||||||||
|
Re: MBTiles TileSet storage
Lynn Deffenbaugh
Another resurrected message with some MBTiles discussion. The issue with creating the numbered directories has been fixed. It does still require an empty directory to point to, even though files should not be placed there any more. Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32 -------- Forwarded Message --------
Ok, to be clear. It only creates the
directories, but doesn't put any actual map tile images in them,
correct? At least, that's what my test here did.
Note: Everywhere that I reference <TileServer> in the following discussion, it's actually the <OSM.*> element that is used which comes from the <TileServer>'s corresponding elements when a new Configure / Map / Tile Set is selected for display. Currently APRSIS32 will still require the <TileServer>'s <Path> to exist and it will still create the numbered directories. But as long as the downloaded tile is successfully stored in the .mbtiles file, it will not be stored in the number directory tree. Eventually <TileServer>s will support an empty <Path> with a non-empty <MBTile> to prevent this behavior. Also, on the <Path> inside the <MBTile>, it should point the whole way to the .mbtiles file. There is no assumption of the name of the file vs the name attribute of the <MBTile> element. So that added block should have had no effect on your test. Here's the current sequence of events when a tile is needed for display: The <MBTile> databases are checked in the order they appear in the XML and only if enabled. If the tile is found and is a valid image, it is used. The <TileServer>'s <MBTiles> file is checked if it is configured and it exists. If the tile is found and is a valid image, it is used. The <TileServer>'s <Path> is checked for a tile file. If it is found and is a valid image, it is used. This same three-step logic is used to look for tiles one or two levels further out which will be stretched for display. Even if a tile is found and stretched, the actual tile will still be downloaded as follows. APRSISMO currently doesn't stretch tiles. If the actual tile is not found, it will be downloaded according to the <TileServer>'s <Server><Port> and <URLPrefix>. If the download is not successful, all ends here. Oh, and the appropriate numbered directory is created at this point in anticipation of a successful download. This will eventually be removed for <MBTiles>-configured servers, but read on. If a tile is successfully downloaded, it is stored in the <TileServer>'s <MBTiles> database. If the database insertion fails, or if an <MBTiles> database is not configured, the downloaded tile is stored in the appropriate numbered directory that was previously created. Once a tile is successfully downloaded, Perfetches are queued for the 2 tiles at -1 and -2 zooms and the 4 tiles at zoom +1. Remember, each tile has 4 tiles "below" it at the next closer zoom level. As each of these is processed, they create the appropriate numbered directories and are subsequently stored as described above. Prefetches do NOT queue additional prefetches, only tiles downloaded for display needs queue prefetches. Now that I've resurrected that knowledge, I wonder why I ended up with numbered directories from 1 through 15 when I was only displaying at zoom 14? 12 through 15 would make sense, but not 1 through 12. Gotta look into that one... Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32
__._,_.___
__,_._,___
|
||||||||||
|
|
||||||||||
|
MBTiles TileSet storage
Lynn Deffenbaugh
Here's an old, but nearly accurate description of firing up an MBTiles file for database storage. It does not describe how to configure an MBTiles file for https:// access but relies on the server in the legacy tile set configuration block. And the URL that it mentions is http://sqlitebrowser.org but I didn't notice it in that writeup. More details to follow, but this is the posting that I thought
was around around somewhere! Lynn (D) - KJ4ERJ - Author of
APRSISCE for Windows Mobile and Win32
-------- Forwarded Message --------
So, you're wondering about the <MBTiles> and <OSM.MBTiles> elements are doing in the APRSIS32.XML file? They are the beginnings of support for using MBTiles (SQLite) databases to store the map tile images instead of directory trees of individual files. You can set this up yourself if you'd like to test it with the following procedure. 0) Make a copy of your working APRSIS32 instance directory so that if you bork it up, you still have a good working copy! 1) Download an empty MBTiles database from http://ldeffenb.dnsalias.net/MBTiles/* - It's called Empty.mbtiles and is only 4,096 bytes. 2) Copy that file to a new name appropriate to the tile set that you'll be placing into it. It is easiest to put it in the default execution directory alongside your APRSIS32.XML file. 3) Edit your APRSIS32.XML file and locate the actual <TileServer> that you want to test with. If you want, you can copy an entire <TileServer>...</TileServer> block to a new entry and change the Name value within the <TileServer Name="xxxx"> element. 4) In that block, add the name that you called the copy of Empty.mbtiles, including the .mbtiles extension and the full path unless it is in your default execution directory. Yes, with full paths multiple instances of APRSIS32 can share a single .mbtiles file. It is important that each instance is drawing from the same tile server or thing can get really confusing really quickly. 5) If you are testing with the currently selected TileSet, then you also need to put the same value in the <OSM.MBTiles> element. Or you can just fire up APRSIS32, switch to a different tile set, and then switch back to the one that is using the <MBTiles> entry. 6) Done. But what does it actually DO and how can I tell if it is working? Well, that's a bit trickier. The easiest way I now of is to make a new copy of a <TileServer> entry and point its <Path> to a newly-created empty directory and specify the <MBTiles> entry as well pointing to a suitably-named copy of the Empty.mbtiles file. Then when you select that new TileServer in a running APRSIS32, you should see the map tiles get downloaded, but nothing should appear in the directory tree. And the .mbtiles file should be growing in size as new tiles are downloaded. Zooming and panning around to fetch lots of tiles should show the .mbtiles file continuing to grow. Then, when you want to see what you've got, open the new .mbtiles file up in the SQLite database browser mentioned earlier and execute the following SQL command: SELECT zoom_level, count(*), min(tile_column), max(tile_column), min(tile_row), max(tile_row) from tiles group by zoom_level order by zoom_level; Or you can just restart APRSIS32 and look in the sqlite trace log to see if it has any zoom level ranges in the .mbtiles file. That output will look something like: WinMain:2018-02-01T21:44:21.183 Test.mbtiles z[1] 2 Tiles x:1-1 y:0-1 WinMain:2018-02-01T21:44:21.183 Test.mbtiles z[2] 2 Tiles x:3-3 y:1-2 WinMain:2018-02-01T21:44:21.183 Test.mbtiles z[3] 3 Tiles x:7-7 y:2-4 WinMain:2018-02-01T21:44:21.183 Test.mbtiles z[4] 20 Tiles x:0-15 y:1-8 WinMain:2018-02-01T21:44:21.184 Test.mbtiles z[5] 60 Tiles x:0-13 y:6-15 WinMain:2018-02-01T21:44:21.184 Test.mbtiles z[6] 206 Tiles x:0-26 y:14-32 WinMain:2018-02-01T21:44:21.185 Test.mbtiles z[7] 137 Tiles x:16-37 y:41-54 WinMain:2018-02-01T21:44:21.185 Test.mbtiles z[8] 360 Tiles x:36-78 y:86-108 WinMain:2018-02-01T21:44:21.187 Test.mbtiles z[9] 535 Tiles x:77-153 y:176-217 WinMain:2018-02-01T21:44:21.188 Test.mbtiles z[10] 591 Tiles x:158-305 y:355-431 WinMain:2018-02-01T21:44:21.190 Test.mbtiles z[11] 498 Tiles x:323-608 y:750-860 WinMain:2018-02-01T21:44:21.191 Test.mbtiles z[12] 494 Tiles x:652-1213 y:1502-1718 WinMain:2018-02-01T21:44:21.192 Test.mbtiles z[13] 426 Tiles x:1564-2423 y:3008-3434 WinMain:2018-02-01T21:44:21.193 Test.mbtiles z[14] 138 Tiles x:4197-4844 y:6018-6866 WinMain:2018-02-01T21:44:21.193 Test.mbtiles z[15] 123 Tiles x:8333-9684 y:11516-12816 WinMain:2018-02-01T21:44:21.200 Test.mbtiles z[16] 73 Tiles x:16771-16781 y:25623-25629 This says that my Test.mbtiles file has tiles from zooms 1 through 16 with a concentration of them (300-500/level) in zooms 8 through 13. The x and y ranges show the actual OSM tile numbers that are cached in that level. Note that this is only the min and max, it does not mean that every tile in the entire x/y rectangle is actually present in the file. If any of you are brave enough to give this a shot, let me know how it goes or especially if it goes bust! And as with the overlays, I'll be incorporating this into the Configure / Map / TileSets / New... user interface. If you use the SQLite database browser and look at the contents of the "metadata" table, you'll notice that it includes TileServer definition information. Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32 PS. Note that not all .mbtiles files are compatible with APRSIS32 tile storage. Some .mbtiles files have been optimized to remove redundant tile images. These .mbtiles files can be used as overlay tilesets, but not as main tile storage as their internal table format is different. As long as the SQLite database browser shows only 2 tables called "metadata" and "tiles", it should be good. For instance, MBTiles files from mapbox have the "tiles" as a view rather than an explicit table. These files can be used as overlay MBTiles, but not as TileSet .mbtiles storage. https://www.mapbox.com/help/define-mbtiles/ and of course, vector tiles are something completely different! https://openmaptiles.com/downloads/planet/ Notice that the satellite views .mbtiles file (available for pay) is 196GB in size. Yes, 196 GIGAbytes! ------------------------------------ Posted by: "Lynn W Deffenbaugh (Mr)" <KJ4ERJ@...> ------------------------------------ ------------------------------------ Yahoo Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/aprsisce/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/aprsisce/join (Yahoo! ID required) <*> To change settings via email: aprsisce-digest@... aprsisce-fullfeatured@... <*> To unsubscribe from this group, send an email to: aprsisce-unsubscribe@... <*> Your use of Yahoo Groups is subject to: https://info.yahoo.com/legal/us/yahoo/utos/terms/
|
||||||||||
|
|
||||||||||
|
https Tile Server (like ThunderForest)
Lynn Deffenbaugh
I just confirmed that ThunderForest's tile servers are accessed via https. This cannot be done with APRSIS32's legacy map tile set configuration. But the newest development version of APRSIS32 can theoretically do this if you can manually configure some information into an MBTiles database file and then edit the APRSIS32.xml configuration file to point a tile set to this database. Note: I just proved that it can do this by a) signing up for a
ThunderForest free account, b) Noting the URL for their
OpenCycleMaps on my dashboard, c) Cloning an empty MBTiles
database and updating the URLFormat metadata element (along with
name and description) to this URL including my API key and
changing the {x} to %x (y and z respectively). Maybe I'll have to
add a ToDo item to support either %x or {x} as the latter seems to
have gained some traction in tile server URL definitions. Details on how to do that will be forthcoming as soon as I write them up. I was searching my e-mail archives to see if I had made any mention of it in the past which is why these old messages are resurfacing. In the meantime, you might want to download and install
http://sqlitebrowser.org Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
PS. Their free account provides 150,000
tile requests per month. I was at 69 with a single full-screen
view at zoom 14. Seems like it might work for an individual user
provided that you're not like me bouncing all over the planet when
I notice an interesting APRS station.
On 6/1/2019 11:29 AM, 'Fred Hillhouse'
fmhillhouse@... [aprsisce] wrote:
|
||||||||||
|
|
||||||||||
|
SARTopo Maps
Lynn Deffenbaugh
I don't see any information on the SARTopo/CalTopo web site
describing direct access to their map tile layers, but if anyone
knows of the proper URL, the new development version of APRSIS32
may be able to access it. Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
On 2/3/2019 6:27 PM, Bill Hancock billwa4mjm@...
[aprsisce] wrote:
|
||||||||||
|
|
||||||||||
|
Re: APRSISCE MBTiles (yet?)
Lynn Deffenbaugh
MBTiles support for APRSIS32 is in the works. Can you provide me
a sample of one or several of your MBTiles files so that I can
verify proper operation with files that I didn't create myself? Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
On 2/3/2019 1:45 PM, n7jzt@...
[aprsisce] wrote:
|
||||||||||
|
|
||||||||||
|
(Meta/MB) Tiles & More! (Dev: 2020/05/14 10:48)
Lynn Deffenbaugh
=========== 2020/05/14 10:48
Fixed infinite loop hang until memory is exhausted in Drive Multiline (discovered doing an outline of Rincon Mountains for tile testing) Add MBTiles path visibiltiy to tile info popup (double-click empty space on map) Support up to 64 (up from32) uniquely active hashes. I really need to migrate this from bit mask to a dictionary lookup but concerned about View filtering performance. Better support MBTiles for tile saving, although still no UI for it. Support MetaTile fetching (ala APRSISMO) from my tile server (until I issue a pull request for my mod_tile updates and persuade the OpenStreetMap folks to run it (doubtful)) Update libcurl to support https from MBTiles-based Map Tile Sets. Note this added a crypt32.DLL requirement, so hopefully there won't be any issues. No idea if this will ever build for Windows Mobile though! Even if not fetching MetaTiles, a single tile download thread will get all required tiles within a single MetaTile. Record and honor Expires/Max-Age from tile server. This may cause more map tile fetches than you're used to as APRSIS32 will refresh expired tiles in the background, but only when you actually visit the area again (currently). So you may be looking at what looks like a complete map, but still see an expanding yellow circle indicating tiles are being fetched. This is normal, and the NEXT time you visit that area (after all caching has purged), you'll see the new version of the map tiles. Since entire MetaTiles are queued to a single thread, the yellow expanding circle should have less granularity (bigger steps) as only metatiles are counted/executed instead of each individual tile. This is regardless of whether metatiles or individual tiles are being fetched. Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32
|
||||||||||
|
|
||||||||||
|
Re: libCURL (Dev: 2020/05/09 21:57)
Fred Hillhouse
Release notes? I don’t need no stinkin’ release notes!
;) Fred N7FMH
From: APRSISCE@groups.io [mailto:APRSISCE@groups.io] On Behalf Of Lynn Deffenbaugh
Sent: Monday, May 11, 2020 11:30 AM To: APRSISCE@groups.io Subject: Re: [APRSISCE] libCURL (Dev: 2020/05/09 21:57)
From the very end of my release notes: The MbTiles layout I'm using includes the full URL in the database, soit will be able to support https (but it doesn't yet, so don't try it!). So, the straight answer is "no", but the true answer is "not yet". Almost there... https://www.youtube.com/watch?v=t93PJlv3EgQ Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32 On 5/11/2020 11:07 AM, Fred Hillhouse wrote: Hi Lynn,Will item 2 get https tiles now?Thanks!Fred N7FMH-----Original Message-----From: APRSISCE@groups.io [mailto:APRSISCE@groups.io] On Behalf Of Lynn DeffenbaughSent: Saturday, May 09, 2020 10:10 PMTo: APRSISCE@groups.ioSubject: [APRSISCE] libCURL (Dev: 2020/05/09 21:57)A new development release has been pushed out that includes two minorchanges:
|
||||||||||
|
|
||||||||||
|
Re: libCURL (Dev: 2020/05/09 21:57)
Lynn Deffenbaugh
From the very end of my release notes:
So, the straight answer is "no", but the true answer is "not yet". Almost there...The MbTiles layout I'm using includes the full URL in the database, so it will be able to support https (but it doesn't yet, so don't try it!). https://www.youtube.com/watch?v=t93PJlv3EgQ Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
On 5/11/2020 11:07 AM, Fred Hillhouse
wrote:
Hi Lynn, Will item 2 get https tiles now? Thanks! Fred N7FMH -----Original Message----- From: APRSISCE@groups.io [mailto:APRSISCE@groups.io] On Behalf Of Lynn Deffenbaugh Sent: Saturday, May 09, 2020 10:10 PM To: APRSISCE@groups.io Subject: [APRSISCE] libCURL (Dev: 2020/05/09 21:57) A new development release has been pushed out that includes two minor changes: 1) Correct handling of satellite and lightning multilines if a { happens to be in the !DAO! 2) Use libcurl instead of custom-coded HTTP/1.0 client for map tile fetching. MUCH faster as it uses HTTP/1.1 and re-uses server connections. That second one is not only a dramatic performance boost for tile fetching, but also lays the groundwork for being able to support https tile sources Of course, those will only happen from MbTiles files as the old tile set definition has no way to specify the protocol to use. The MbTiles layout I'm using includes the full URL in the database, so it will be able to support https (but it doesn't yet, so don't try it!). Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus
|
||||||||||
|
|
||||||||||
|
Re: libCURL (Dev: 2020/05/09 21:57)
Fred Hillhouse
Hi Lynn,
toggle quoted messageShow quoted text
Will item 2 get https tiles now? Thanks! Fred N7FMH
-----Original Message-----
From: APRSISCE@groups.io [mailto:APRSISCE@groups.io] On Behalf Of Lynn Deffenbaugh Sent: Saturday, May 09, 2020 10:10 PM To: APRSISCE@groups.io Subject: [APRSISCE] libCURL (Dev: 2020/05/09 21:57) A new development release has been pushed out that includes two minor changes: 1) Correct handling of satellite and lightning multilines if a { happens to be in the !DAO! 2) Use libcurl instead of custom-coded HTTP/1.0 client for map tile fetching. MUCH faster as it uses HTTP/1.1 and re-uses server connections. That second one is not only a dramatic performance boost for tile fetching, but also lays the groundwork for being able to support https tile sources Of course, those will only happen from MbTiles files as the old tile set definition has no way to specify the protocol to use. The MbTiles layout I'm using includes the full URL in the database, so it will be able to support https (but it doesn't yet, so don't try it!). Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus
|
||||||||||
|
|
||||||||||
|
Re: Downloads (was: 2020/05/09 21:57)
Gervais Fillion <ve2ckn2@...>
thanks Lynn
you are the Best now!!!
73
Gervais i will try it,
i hoped to have a better chance on setting his Digipeater than i have in Uiview (no offence Roger upthere)
ve2ckn
De : APRSISCE@groups.io <APRSISCE@groups.io> de la part de Lynn Deffenbaugh <kj4erj@...>
Envoyé : 10 mai 2020 20:18 À : APRSISCE@groups.io <APRSISCE@groups.io> Objet : [APRSISCE] Downloads (was: 2020/05/09 21:57) If you already have it up and running, just use About. Otherwise it's on the Wiki at:
http://aprsisce.wikidot.com/downloads
And you might want to watch the First Use video at:
http://aprsisce.wikidot.com/initial-startup
And there's already been a couple of development releases since the general. You can get those by following the instructions at:
http://aprsisce.wikidot.com/doc:development-version Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32
On 5/10/2020 6:54 PM, Gervais Fillion wrote:
|
||||||||||
|
|
||||||||||
|
Downloads (was: 2020/05/09 21:57)
Lynn Deffenbaugh
If you already have it up and running, just use About. Otherwise it's on the Wiki at:
http://aprsisce.wikidot.com/downloads
And you might want to watch the First Use video at:
http://aprsisce.wikidot.com/initial-startup
And there's already been a couple of development releases since the general. You can get those by following the instructions at:
http://aprsisce.wikidot.com/doc:development-version Lynn (D) - KJ4ERJ - Author of APRSISCE for Windows Mobile and Win32
On 5/10/2020 6:54 PM, Gervais Fillion
wrote:
|
||||||||||
|
|
||||||||||
|
Re: XP Users (Dev: 2020/05/09 21:57)
Gervais Fillion <ve2ckn2@...>
Excuse guy's,
what is the link again to download it?
i am still on XP Pro on my UIview Gate,, i will try again Andrew if it start the install.
Thanks all for all your work on APRS
Gef
VE2CKN
De : APRSISCE@groups.io <APRSISCE@groups.io> de la part de ab8xg via groups.io <ab8xg@...>
Envoyé : 10 mai 2020 18:18 À : APRSISCE@groups.io <APRSISCE@groups.io> Objet : Re: [APRSISCE] XP Users (Dev: 2020/05/09 21:57) I am running it on an old acer mini laptop with xp. No problems so far everything started and ran great. And then it quit recieving so I tried my cord and a differant program and then a differant computer and finally a differant tnc. Ended up being something
in the tnc, I restored it and now it's working fine. Have only been running the new version for a couple of days but absolutely no problems so far with it. Will see what happens this week when I try to incorporate the weather station.
Thanks for all your work on this.
|
||||||||||
|
|
||||||||||
|
Map Moving (was: 2020/05/09 21:57)
Lynn Deffenbaugh
Yes, just copy the entire tile tree from where it is and make sure the new config points to the directory where you copied it. I find it best to zip up the tree and unzip on the other end since there are LOTS of files. Once MbTiles integration is complete, it will be a lot easier.
I'm planning a migration pulling tile files into a newly create
MbTiles database just to preserve what was already downloaded. Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
On 5/10/2020 5:50 PM, K3RWN wrote:
|
||||||||||
|
|
||||||||||
|
Re: XP Users (Dev: 2020/05/09 21:57)
ab8xg
I am running it on an old acer mini laptop with xp. No problems so far everything started and ran great. And then it quit recieving so I tried my cord and a differant program and then a differant computer and finally a differant tnc. Ended up being something in the tnc, I restored it and now it's working fine. Have only been running the new version for a couple of days but absolutely no problems so far with it. Will see what happens this week when I try to incorporate the weather station.
toggle quoted messageShow quoted text
Thanks for all your work on this.
|
||||||||||
|
|
||||||||||
|
Re: XP Users (Dev: 2020/05/09 21:57)
K3RWN
I am thinking about giving it a go on an old XP Netbook. Is there a way to copy the map files to the hard drive and for go the need for internet to permit map zooming?
Rich
On 5/10/2020 10:23 AM, Lynn Deffenbaugh
wrote:
|
||||||||||
|
|
||||||||||
|
Re: Weather Station Interface
Lynn Deffenbaugh
From the Wxnow.txt file linked to the Wiki: https://cumuluswiki.org/a/Wxnow.txt
Lynn (D) - KJ4ERJ - Author of APRSISCE
for Windows Mobile and Win32
On 5/10/2020 1:06 PM,
mkellync@... wrote:
|
||||||||||
|
|
