delta-sharing package issue in pyspark

[param422]

Hi Team,

Requirement: Install delta_sharing package in one of our EMR server.

We have installed the package in python using the below command and we are able to se and access the package.

pip install delta-sharing

Now, the issue is when we try to import this package from pyspark (jupyter notebook) it is giiving No Module error.

Below is the screenshot of the error.

Can you please assit on this as this is critical to our project.

[param422]

Could you please help us on this issue.

[param422]

hi team, could you please help me on this issue.

[linzhou-db]

@param422 Sorry for the delay, taking a look.

[zsxwing]

@param422 Could you try some other python library? I feel it's likely you are using the right way to install python libraries for jupyter notebook.

I found this post from EMR: https://aws.amazon.com/cn/blogs/big-data/install-python-libraries-on-a-running-cluster-with-emr-notebooks/

Could you try above and see if it works?