Redesign of pipeline

• Use memory mapped table as internal data storage instead of FITS tables:
  • Massive performance improvements (up to 5x faster, depends on system)
  • Better scaling with simulation size and parallelisation
  • Database-like queries to export sub-samples
  • Added processing history and extensive logging
• Removed most command-line arguments in favour of configuration files
• Simplified the pipeline structure which simplifies
  • adding of new features
  • adding new sample selection functions
  • adding support for new input simulation catalogues (currently: MICE2 and Flagship)
• Tested against results from version 1.1 for MICE2

MICE2 mock pipeline for Wright+19 and Joudaki+19

Changes

• Fixed compatibility issue of KV450 deepfield wrapper scripts with BPZ wrapper
• Bug fixed due to which the photometry realisations of the KV450 DEEP2 and VVDS where based on zCOSMOS

IMPORTANT: Use only with jlvdb/table_tools v1.0.1 and jlvdb/stomp_tools v1.0 (attached).