Changes between Version 5 and Version 6 of DataStorageEN


Ignore:
Timestamp:
Jan 5, 2011, 1:12:52 AM (10 years ago)
Author:
Martin Kolman
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • DataStorageEN

    v5 v6  
    1212
    1313'''NOTE:''' ''Because of the FAT32 file-system used in !MyDocs, you should consider enabling sqlite tile storage (in '''options->map->tile storage'''). FAT32 uses very large per-file clusters, which together with map data that consists of thousands of individual tiles causes huge waste of space. Sqlite can store thousands of tiles in a single file and thus avoids this issue.''
     14
     15=== sqlite tile storage ===
     16''available since '''V0.16-1'''''
     17
     18'''What is this good for ?'''
     19As mentioned earlier in this thread and also in a related Mappero thread, tile take up more space than expected because each tile, even if only 500B in size, takes a whole 64kB cluster.
     20When using sqlite for tile storage, there are basically just 2 files per layer, not the usual tens of thousands of files and folders.
     21
     22'''How to enable sqlite tile storage ?'''
     23Go to '''options'''->'''map''' and switch '''tile storage''' from '''files''' to '''sqlite'''.
     24
     25'''Is it stable ?'''
     26It seems to work OK for both normal automatic tile download (including overlay) and batch download. But some errors can still can show up, so please report any unusual behavior when using this ! :)
     27
     28'''What about the 4GB maximum file size limit on FAT32 ?'''
     29When a size of the storage database reaches 3.7 GB, a new one is added. The is no limit on the number of storage databases.
     30
     31'''How does it work ?'''
     32The tiles are stored in a sqlite database as blobs. There are two types of database files, [I]lookup.sqlite[/I] and [I]store.sqlite[/I]. The lookup file stores an database that indicates in which store the requested tile is. The store file has the actual data. Multiple stores should be numbered in ascending order, starting from 0:
     33{{{
     34store.sqlite.0
     35store.sqlite.1
     36store.sqlite.2
     37etc.
     38}}}
     39
     40The storage database looks like this:
     41{{{table tiles (z integer, x integer, y integer, store_filename string, extension varchar(10), unix_epoch_timestamp integer, primary key (z, x, y, extension))}}}
     42The store databases look like this:
     43{{{table tiles (z integer, x integer, y integer, tile blob, extension varchar(10), unix_epoch_timestamp integer, primary key (z, x, y, extension))}}}
     44The only difference in the structure is that the lookup databases only stores the name of the store for given coordinates and the store database stores the actual blob.
     45Both also have a table called called version which has an integer column called v.  There is a single 1 inserted, which indicates the current version of the table.
     46
     47These database files are stored in the
     48corresponding layer folders.
     49
     50When looking for a tile in the database, modRana first asks the lookup database and when it gets an answer, it asks the store described in the store_filename for the given coordinates.
     51
     52'''Could this be used by other navigation apps ?'''
     53Why do you think I just roughly described how it works ? :D
    1454
    1555== POI ==