Store records in off-heap memory

[JohannesLichtenberger]

In order to keep GC to a minimum (despite of low latency Garbage Collectors as for instance Shenandoah), we could try to store the records/nodes off-heap using the foreign memory API for instance, and compare performance.

[JohannesLichtenberger]

Probably we should simply store the trx intent log in a Chronicle map instead of a simple HashMap.

[JohannesLichtenberger]

https://minborgsjavapot.blogspot.com/2019/07/java-chroniclemap-part-1-go-off-heap.html

Should'nt be hard to implement.

[abhinax4991]

Hey @JohannesLichtenberger Guten tag , would like to work on this can you please assign this to me.

[JohannesLichtenberger]

@abhin-dynamify I wonder if serialization of page (fragments) and deserialization will be an issue and if it's faster or even slower. Same for Caffeine caches (the lightweight buffer manager)... that said, with the Caffeine caches, if the maximum sizes are too large, I've had severe performance issues regarding the GC (especially with the ZGC, apparently maybe because it is not generational yet).

[JohannesLichtenberger]

We can try and compare performance in a separate branch 👍

[JohannesLichtenberger]

@abhin-dynamify hope it makes sense. Do you work on this?

[abhinax4991]

@abhin-dynamify hope it makes sense. Do you work on this?

yeah i am working on it

[JohannesLichtenberger]

@abhin-dynamify did you have time?