You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The api documentation on connectedComponents is not clear about what the checkpointInterval argument is affecting:
"checkpointInterval – checkpoint interval in terms of number of iterations (default: 2)"
Does the value of this argument have impact on performance? On actual results?
The text was updated successfully, but these errors were encountered:
Based on the usage of the variable checkpointInterval elsewhere in Spark, this implies the frequency at which we cache the results but it requires a checkpoint directory to be set in the SparkContext. So there will be a performance hit I think.
The api documentation on connectedComponents is not clear about what the checkpointInterval argument is affecting:
"checkpointInterval – checkpoint interval in terms of number of iterations (default: 2)"
Does the value of this argument have impact on performance? On actual results?
The text was updated successfully, but these errors were encountered: