You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@ax3l I tried using dask delayed with openpmd-api for parallelization over iterations. I couldn't get it to work, I think, because dask wasn't able to pickle the series object. Would it make sense to add add_pickle to Series and Iteration?
For the first implementation of multi-process (multi-node) Dask, we pickle objects like the Record and RecordComponents + their series.
The series is unpickled into a static function member, to avoid:
This works as a hack until you need to work with two series at a time.
https://github.com/openPMD/openPMD-api/blob/0.15.1/include/openPMD/binding/python/Pickle.hpp#L73-L77
The text was updated successfully, but these errors were encountered: