Using externally stored data within tests

[eseiler]

I currently use an archive of the structure:

example_data/
├── 1024
│   ├── bins
│   └── reads
└── 64
    ├── bins
    └── reads

where the bins and reads directory contain 64 1024 files each, respectively.

It doesn't seem easily possible to extract that archive.tar.gz to provide, say, 1024/bins/... etc. in the data directory.
To do so, I need to hard-code the steps in the app_datasources.cmake

app-template/test/cmake/app_datasources.cmake

Line 57 in 90659e3

${CMAKE_COMMAND} -E create_symlink <DOWNLOADED_FILE> ${CMAKE_CURRENT_BINARY_DIR}/data/${ARG_FILE}

Maybe there is a more elegant solution?

[joergi-w]

Maybe try DOWNLOAD_NO_EXTRACT FALSE in

app-template/test/cmake/app_datasources.cmake

Line 60 in 90659e3

DOWNLOAD_NO_EXTRACT TRUE # don't extract archive files like .tar.gz.

?

[eseiler]

Doesn't work, in fact it does nothing at all - at least when I tried it.

https://ftp.imp.fu-berlin.de/pub/seiler/raptor/example_data.tar.gz is the data and I specify

            INSTALL_COMMAND
                tar -C ${CMAKE_CURRENT_BINARY_DIR}/data/ -zxf <DOWNLOADED_FILE>

(which is a lot less than I did in the beginning where I also moved the files around, now I just extract them)

[eseiler]

I noticed that on my CI it actually tries to extract with DOWNLOAD_NO_EXTRACT FALSE, but not on the server where I develop or my local machine.
CMake version on server: 3.16.2
CMake version on local machine: 3.16.3
CMake version on CI: 3.18.3