Changes between Version 18 and Version 19 of dataRepositoryManager


Ignore:
Timestamp:
Oct 17, 2012, 11:34:40 AM (12 years ago)
Author:
Martin Kolman
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • dataRepositoryManager

    v18 v19  
    33= modRana data repository document =
    44This is a description for a simple program, that should generate a data repository for offline Monav routing data. It should be flexible enough to enable extending it to also handle other data in the future.
     5
     6== Wokflow ==
     71. download source data
     82. do data processing
     93. package results
     104. move packages to repository
     115. update packages in repository & update manifest
     12
     13=== Sequential ===
     14The initial repository implementation will run all the steps in order.
     15
     16=== Parallel ===
     17As most modern systems have at least two independent CPU cores, the repository should parallelize as many operations as possible.
     18
     19Parallel workflow:
     201. download source data - single downloading thread (due to Geofabrik download slot limitations)
     212. do data processing - multiple threads possible
     223. package results - multiple packagers
     234. move & publish - single publishing thread (as this is most probably IO bound)
     24 1. move packages to repository
     25 2. update packages in repository & update manifest
     26
     27
    528
    629== Requirements ==