Skip to content

Latest commit

 

History

History
18 lines (13 loc) · 1.04 KB

configuration.md

File metadata and controls

18 lines (13 loc) · 1.04 KB

The supported configuration parameters are:

Spark Context configuration parameters

  • spark.redis.host - host or IP of the initial node we connect to. The connector will read the cluster topology from the initial node, so there is no need to provide the rest of the cluster nodes.
  • spark.redis.port - the initial node's TCP redis port.
  • spark.redis.user - the initial node's AUTH user
  • spark.redis.auth - the initial node's AUTH password
  • spark.redis.db - optional DB number. Avoid using this, especially in cluster mode.
  • spark.redis.timeout - connection timeout in ms, 2000 ms by default
  • spark.redis.max.pipeline.size - the maximum number of commands per pipeline (used to batch commands). The default value is 100.
  • spark.redis.scan.count - count option of SCAN command (used to iterate over keys). The default value is 100.
  • spark.redis.rdd.write.iterator.grouping.size - applied for RDD write operations, the number of items to be grouped when iterating over underlying RDD partition
  • spark.redis.ssl - set to true to use tls