Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Critical error in python API, killed when subtables are empty #452

Open
lz100 opened this issue Jan 19, 2024 · 0 comments
Open

Critical error in python API, killed when subtables are empty #452

lz100 opened this issue Jan 19, 2024 · 0 comments

Comments

@lz100
Copy link

lz100 commented Jan 19, 2024

When I use the python API to download some tables, this happed:

xxx/.venv/lib/python3.10/site-packages/delta_sharing/reader.py:123: FutureWarning: 
The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. 
In a future version, this will no longer exclude empty or all-NA columns when determining 
the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.
Killed

It happen on this line code in your API:

        merged = pd.concat(
            pdfs,
            axis=0,
            ignore_index=True,
            copy=False,
        )

It seems some of the pfds are empty. Some of other tables worked, but this one had this error. I tried a few times with the same thing. This table is managed by an outside company so I have no idea what's in there. It was killed before I get a chance to see the content.

I was using V1.03
pandas 2.14

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant