Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chunk API: Add new API and functionality for reading and writing chunks #3794

Open
wants to merge 6 commits into
base: develop
Choose a base branch
from

Conversation

dgault
Copy link
Member

@dgault dgault commented Mar 14, 2022

An initial prototype of potential new API methods for reading and writing N dimensional chunks of data rather than 2d planes/tiles. These new methods currently have default implementations in FormatReader and FormatWriter than pass through to the current 2D API, so they should be useable. This will be accompanied by a PR on ZarrReader which would be the first instance of a Reader which uses the chunk API by default.

The naming and parameters are all open for debate/suggestions, one of the trickier areas with this is how to handle the DimensionOrder going forward. Currently it is reusing the existing 5D dimensionOrder string.

@imagesc-bot
Copy link

This pull request has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/ome-zarr-in-qupath/65666/5

@sbesson sbesson marked this pull request as draft October 3, 2022 13:34
/* @see IFormatWriter#setChunkSize(int[]) */
@Override
public int[] setChunkSize(int[] chunkSize) throws FormatException {
int[] returnChunkSize = {setTileSizeX(chunkSize[0]), setTileSizeY(chunkSize[1]), 1, 1, 1};
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Back to @melissalinkert's question about what would test this code, this could warn or error if a >2D chunk size were requested.

@dgault dgault marked this pull request as ready for review February 28, 2023 12:41
@dgault dgault added this to the 6.14.0 milestone Apr 19, 2023
@dgault dgault modified the milestones: 6.14.0, 7.1.0 Jun 15, 2023
@imagesc-bot
Copy link

This pull request has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/bioformats2raw-conversion-using-3d-chunks-takes-much-longer-than-2d-chunks/83008/6

@melissalinkert
Copy link
Member

Temporarily excluding since this is scheduled for 8.0.0 and conflicts with things scheduled for 7.1.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants