Sinks

Data sinks enable Joule to integrate to downstream systems which provide further value to additional business cases

Available options

Streaming

Kafka

Kafka subscriber transport emits events to target topics.

RabbitMQ

RabbitMQ is lightweight and easy to deploy messaging platform.

MQTT

Joule provides the ability to publish events using MQTT publisher

Databases

SQL

Write event micro batches to any databased that supports JDBC Type 4 drivers

InfluxDB

Standard time series database idea for instrumentation or live KPIs

MongoDB

Publish Json based events to the mature standard document store

Geode

Distributed caching integration that enable advanced use cases

HTTP

Web sockets

Web socket publisher transport emits processed events to web based clients.

File

MinIO S3

MinIO file producer using S3 cloud or local hosted buckets

File

Write events directly to file using the Joule supported formats

Transformation

Publishers receive StreamEvents which need to be converted to a desired output format. Currently the following formatters are provided.

• CSV

• JSON

• Parquet

• AVRO

The Joule SDK provides interfaces for custom formatter code. Read the Joule SDK documentation for more information.