- add functionality to help with managing schema evolution (forward- and backwards-compatibility).
- add test for type store implementations to check whether the min and max values are correctly tracked
- verify whether blockSize: 128 and miniBlockCount in (*byteArrayDeltaLengthEncoder).Close() is correct.
- in (*byteArrayStore).setMinMax() whether the bytes.Compare calls are correct.
- rewrite booleanPlainEncoder implementation using packed array.
- readPageData: having a dictEncoder/decoder is wrong. they should be a plain decoder for header and a int32 hybrid for values. the mix should happen here not in the dict itself
- writeChunk: check whether parquet.Encoding_RLE is actually required.
- improve (*ColumnStore).reset() so that it works without losing schema information in the typed column store.
- check whether (*FileWriter).FlushRowGroup() should still return an error if the number of records in the row group is 0.
- in (*FileWriter).FlushRowGroup() add support for sorting columns.
- in (*FileWriter).Close() add support for column orders.
- check whether it is feasible to implement a block cache in the packed array implementation
- dictPageWriter: add support for sorted dictionary.
- schema.go: the current design suggest every reader is only on one chunk and its not concurrent support. we can use multiple reader but its better to add concurrency support to the file reader itself
- schema.go: add validation so every parent at least have one child.
- (*schema).ensureRoot(): a hacky way to make sure the root is not nil (because of my wrong assumption of the root element) at the last minute. fix it
- (*schema).ensureRoot(): provide a way to override the root column name
- parquet-tool cat: add support for detailed schema (-d)
- parquet-tool head: add support for detailed schema (-d)
- parquet-tool schema: add support for detailed schema (-d)