Use Arquero for query processing and transformation of data

[thinkh]

Recently, I stumbled upon the Arquero library from the Interactive Data Lab from the University of Washington.

I read through parts of the documentation and tried some interactive examples from their Observable notebooks. As far as I can see, it would support all data operations that LineUp requires (and provide even more features):

• Load data from an array of objects, JSON, CSV, ...
• Sort by a single or multiple criteria
• Group by a single or multiple criteria
• Filter by criteria

I could imagine that we could replace a lot of data operations from the local data provider with Arquero and hence reduce the complexity of our source code.

@sgratzl What do you think about this?

Further resources

• Observable Notebooks with some guides and tutorials
• Illustrated guide to Arquero verbs
• Visual data wrangler

[sgratzl]

yeah I've heard about it. One thing I wonder regarding lineup, how the notion of accessors will complicate things. So far LineUp itself doesn't require to have a plain data structure as input, e.g. the lazy loaded columns are not in the main data but kinda "injected" using a custom accessor.