You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Apr 27, 2022. It is now read-only.
python3 APK installs only /usr/bin/python3 binary, but by default PySpark searches for python binary in PATH. This results in kernel error when enabling Spark in a notebook:
2019-11-19T10:55:15.696952916Z /usr/bin/find-spark-home: line 40: python: command not found
2019-11-19T10:55:15.697407078Z /usr/bin/spark-submit: line 27: /bin/spark-class: No such file or directory
I see two solutions to this problem. In Dockerfile:
Thanks for your suggestions on this and the other issue, and sorry for the slow response! Things have been quite busy for me since late November, and I hadn't been checking out this repo.
Both of your suggestions seem great, and I'll look to incorporate them later this week. Hope you have a Happy New Years! 🎊
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
python3 APK installs only
/usr/bin/python3
binary, but by default PySpark searches forpython
binary in PATH. This results in kernel error when enabling Spark in a notebook:I see two solutions to this problem. In Dockerfile:
python
topython3
:PYSPARK_PYTHON
variable (not tested, as for https://stackoverflow.com/questions/30279783/apache-spark-how-to-use-pyspark-with-python-3):The text was updated successfully, but these errors were encountered: