Skip to content
This repository has been archived by the owner on Feb 7, 2024. It is now read-only.

VerdigrisTech/spark-streaming-mqtts

Repository files navigation

spark-streaming-mqtts License

This module adds client side SSL certificate and TLS v1.2 support to the MQTTUtils class provided by spark-streaming-mqtt package.

Prerequisites

  • Scala 2.10+
  • sbt 0.13+ (if building from source)

Dependencies

Usage

Submitting standalone Spark Streaming jobs

You can include this package into your standalone Spark Streaming package as a fat JAR or provide it using the --jars option for Spark CLI tools (e.g. spark-submit).

If submitting the job with the --jars options, be sure to include the dependencies as well.

Thin JAR example:

$ spark-submit --jars spark-streaming-mqtts-0.1.0.jar,\
spec-pkcs1-0.1.0.jar,\
org.eclipse.paho.mqttv3.jar \
YOUR-STANDALONE-SPARK-APP.jar

Building

Before you begin, you will need SBT version 0.13 or higher to build this project.

To manually build this package from source, just run:

$ sbt package

License

Distributed under Apache 2.0 license.

About

Spark Streaming receiver that supports MQTT over TLS v1.2 with X.509 client certificate based authentication.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages