Pandas pyarrow implications #309
bamacgabhann
started this conversation in
Ideas
Replies: 1 comment
-
I've performed some preliminary tests with GeoPandas and GeoFeather and remember running into issues with datetimes. I'll try to revisit and see if I can reproduce them. I assume GeoFeather uses the convert_dtypes logic in the background but haven't done any digging yet. GeoDataFrames without timestamps did work for me, however. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Discussed in #307
Originally posted by bamacgabhann May 1, 2023
Originally posted by anitagraser May 1, 2023
4. Unfortunately, I'm not familiar with the potential consequences of this choice.
5. That is an excellent question but I haven't investigated this yet, so I don't know.
Splitting this off for separate discussion for clarity. I had a quick look and can't see any references to dtype_backend="pyarrow" on the geopandas repo, and trying
gdf.convert_dtypes(dtype_backend="pyarrow")
returnsTypeError: Cannot interpret '<geopandas.array.GeometryDtype object at 0x7f04eef1e440>' as a data type
. So I'd infer pyarrow doesn't currently support geo data, which would probably make this discussion premature.It would probably be best if someone who knows pandas and pyarrow better than me looks into this, but I'll have a closer look at some point soon if nobody else volunteers first.
Beta Was this translation helpful? Give feedback.
All reactions