Joule
Search
K
Comment on page

Change Data Capture

Change Data Capture (CDC) processor identifies and processes only data that has changed and then makes this changed data available for further use. The process determines change based upon the previous values held for the tracking fields.

Example

This will emit changed StreamEvents keyed on symbol when either the broker, bid and ask values change.
change data capture:
key field: symbol
tracking fields:
- broker
- bid
- ask
emit only changes: true
drop duplicates: true

Attributes

Attribute
Description
Data Type
Required
key field
Key field to
String
fields
List of fields to track and determine changes
List<String>
emit only changes
A flag to emit only a delta event for the changes seen on the record. If set to false changes found will be will be added, as a map, to the CDC_FIELD event along with a CDC field being set to true to signify record availability.
Boolean
Default: true
drop duplicates
Control flag which can be set to validate processor functionality at runtime. Use a JMX console to set.
Boolean
Default: true