Change Data Capture

Change Data Capture (CDC) processor identifies and processes only data that has changed and then makes this changed data available for further use. The process determines change based upon the previous values held for the tracking fields.

Example

This will emit changed StreamEvents keyed on symbol when either the broker, bid and ask values change.

change data capture:
  key field: symbol
  tracking fields:
    - broker
    - bid
    - ask
  emit only changes: true
  drop duplicates: true

Attributes

AttributeDescriptionData TypeRequired

key field

Key field to

String

fields

List of fields to track and determine changes

List<String>

emit only changes

A flag to emit only a delta event for the changes seen on the record. If set to false changes found will be will be added, as a map, to the CDC_FIELD event along with a CDC field being set to true to signify record availability.

Boolean

Default: true

drop duplicates

Control flag which can be set to validate processor functionality at runtime. Use a JMX console to set.

Boolean

Default: true

Last updated