On-disk support (network fs)

[danthegoodman1]

Have a mode where it operates off disk instead of S3 in case of using something like AWS fsx lustre. That might provide better managed performance, especially for reading the log.

[loicalleyne]

Is this for both the metastore and the parquet data files? I suppose this would work with a local RAID drive setup as well?

[danthegoodman1]

Yeah it would be really for any locally mounted disk most likely, and yes both would be supported as they are currently colocated under one parent directory for the table

[danthegoodman1]

Also useful for JuiceFS

[danthegoodman1]

Should be able to chose location for log and data separately, so could chose to have log on disk but data in s3