Skip to content

splitgraph/delta-rs-write-profiling

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Memory profiling of delta-rs writer

To run you'll first need a Parquet file handy, for example:

curl -o supply-chains.parquet https://seafowl-public.s3.eu-west-1.amazonaws.com/tutorial/trase-supply-chains.parquet 

Then simply execute the profiling script, passing in the location of the Parquet file:

./profile.sh /home/ubuntu/supply-chains.parquet

This will build the bytehound binaries needed for profiling, run the profiling and then open a server that provides a UI to investigate the recorded memory profiles.

About

A simple memory profiler tool for delta-rs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published