Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support conversion from pyarrow RecordBatch to pandas DataFrame #39

Merged
merged 10 commits into from Nov 8, 2021

Conversation

tswast
Copy link
Collaborator

@tswast tswast commented Nov 3, 2021

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #38 🦕

@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-db-dtypes-pandas API. label Nov 3, 2021
@google-cla google-cla bot added the cla: yes This human has signed the Contributor License Agreement. label Nov 3, 2021
@tswast tswast marked this pull request as ready for review November 4, 2021 15:37
@tswast tswast requested a review from a team November 4, 2021 15:37
@tswast tswast requested a review from a team as a code owner November 4, 2021 15:37
@tswast
Copy link
Collaborator Author

tswast commented Nov 4, 2021

3.10 failure should be resolved by #40

@tswast tswast mentioned this pull request Nov 4, 2021
db_dtypes/__init__.py Outdated Show resolved Hide resolved
db_dtypes/__init__.py Outdated Show resolved Hide resolved
),
),
]

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similarly, I'm curious what happens if the PyArrow type is timestamp("ns"), just to cover all possible inputs.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I assume you meant time64("ns"). I've added a test case, which uncovered a bug in _datetime, which I've fixed.

Copy link

@loferris loferris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could perhaps expand testing cases, but LGTM.

@tswast tswast added automerge Merge the pull request once unit tests and other checks pass. and removed automerge Merge the pull request once unit tests and other checks pass. labels Nov 8, 2021
@tswast tswast merged commit facc7b0 into main Nov 8, 2021
@tswast tswast deleted the issue38-from_arrow branch November 8, 2021 22:48
@gcf-merge-on-green gcf-merge-on-green bot removed the automerge Merge the pull request once unit tests and other checks pass. label Nov 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-db-dtypes-pandas API. cla: yes This human has signed the Contributor License Agreement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

need __from_arrow__ to support types_mapper
3 participants