Support new IDAaaS data cache index files #37013
Labels
IDAaaS Only
Only on IDAaaS
ISIS Team: Core
Issue and pull requests managed by the Core subteam at ISIS
Milestone
Is your feature request related to a problem? Please describe.
When using the ISIS experiment data archive, there is a quick way of looking up files for a given instrument name and run number (see here).
ISIS users (who are not staff) do not have access to the data archive, and instead must rely on the instrument data cache. Currently there is a workaround where each of the experiment directories associated with a user is automatically added to their list of mantid user directories, but for some people with access to many experiments this results in a very slow search.
Describe the solution you'd like
The IDAaaS team will be adding a new index file named
INSTRUMENT_index.txt
to the top level of each instrument folder, e.g.The file is a text file with two columns: run number and relative path to the data location, e.g.
The run numbers in a given file will be unique and in ascending order.
Our task is to make use of these new index files to efficiently find data files based on the instrument name and run number in an analogous way to the archive search service.
We should consider the precedence of where to search first - archive, local files, data cache?
We may want the user to be able to override the default precedence.
Additional context
The original issue created for discussion is here and may provide more context:
#36923
List of things to do
The text was updated successfully, but these errors were encountered: