Explore Seralization Formats for Exporting from Lily

[frrist]

Seralizations Formats

Currently lily can export data in the form of SQL transactional statements or CSV. We should explore more alternatives to increase the flexibility of Lily:

• JSON (newline delimited)
• Protobuf (WARNING no deterministic encoding)
• CBOR
• BSON
• Thrift
• Avro
• Parquet
• ...

The aim of this issue is to explore and document the tradeoffs of different encodings and rank them in order of expected utility to Lily and its stakeholders.