You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am getting the following error for version 4.1.0 (jupyterlab 3.1.9, pyspark 3.1.2):
---------------------------------------------------------------------------
NameError Traceback (most recent call last)
/tmp/ipykernel_139706/319767949.py in <module>
2
3 # start the spark context using the SparkConf the extension inserted
----> 4 sc=SparkContext.getOrCreate(conf=conf) #Start the spark context
NameError: name 'conf' is not defined
However, this works fine in the following scenarios:
in your docker container (jupyterlab 3.0.16, pyspark 2.4.5, jupyterlab-sparkmonitor 3.0.1)
in my own conda environment (jupyterlab 3.1.9, pyspark 2.4.8, jupyterlab-sparkmonitor 3.1.0)
I wonder if pyspark 3.1 is not supported yet?
The text was updated successfully, but these errors were encountered:
I am getting the following error for version 4.1.0 (jupyterlab 3.1.9, pyspark 3.1.2):
However, this works fine in the following scenarios:
I wonder if pyspark 3.1 is not supported yet?
The text was updated successfully, but these errors were encountered: