You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to use reproject with some large images. Even though the FITS files are 12 GB and my system has 64 GB of RAM, I'm running out of memory, so I've been investigating ways to be more memory efficient. I'm currently trying to implement the memmap recommendation from the docs.
In so doing, reproject start rejected an innocuous-seeming transformation:
ValueError: An output array of a different type than the input array was specified, which will create an undesired duplicate copy of the input array in memory.
I'm explicitly initializing my arrays to have the same dtype — how is this happening?
The input array is float32 data, and on my machine, at least (Linux x86_64 numpy 1.21.2), this line converts it to float64. This is counterintuitive at best and is also going to be doubling my memory consumption.
I'm pretty sure that this is a mistake — unless I'm missing something? I wanted to ask before working on a PR, although I'm pretty sure that there's a one-line way to ensure float-ness without unnecessarily converting.
The text was updated successfully, but these errors were encountered:
I'm trying to use reproject with some large images. Even though the FITS files are 12 GB and my system has 64 GB of RAM, I'm running out of memory, so I've been investigating ways to be more memory efficient. I'm currently trying to implement the memmap recommendation from the docs.
In so doing, reproject start rejected an innocuous-seeming transformation:
with:
I'm explicitly initializing my arrays to have the same dtype — how is this happening?
The culprit turns out to be:
reproject/reproject/interpolation/core.py
Line 73 in 43b0d8a
The input array is float32 data, and on my machine, at least (Linux x86_64 numpy 1.21.2), this line converts it to float64. This is counterintuitive at best and is also going to be doubling my memory consumption.
I'm pretty sure that this is a mistake — unless I'm missing something? I wanted to ask before working on a PR, although I'm pretty sure that there's a one-line way to ensure float-ness without unnecessarily converting.
The text was updated successfully, but these errors were encountered: