Pulsar adaptor for Apache Spark
An application can receive data in Resilient Distributed Dataset (RDD) format via the Spark Streaming receiver and can process it in a variety of ways.
Maven
If you’re using Maven, add this to your pom.xml
:
Gradle
Usage
Pass an instance of SparkStreamingPulsarReceiver
to the method in JavaStreamingContext
:
Note that if needed, other Pulsar authentication classes can be used. For example, in order to use a token during authentication the following parameters for the constructor can be set: