Comment on page

Change Data Capture

Change Data Capture (CDC) processor identifies and processes only data that has changed and then makes this changed data available for further use. The process determines change based upon the previous values held for the tracking fields.
Example
This will emit changed StreamEvents keyed on symbol when either the broker, bid and ask values change.
change data capture:
  key field: symbol
  tracking fields:
    - broker
    - bid
    - ask
  emit only changes: true
  drop duplicates: true
Attributes
Attribute
Description
Data Type
Required
key field
Key field to 
String
fields
List of fields to track and determine changes
List<String>
emit only changes
A flag to emit only a delta event for the changes seen on the record. If set to false  changes found will be will be added, as a map, to the CDC_FIELD event along with a CDC field being set to true to signify record availability.
Boolean
Default: true
drop duplicates
Control flag which can be set to validate processor functionality at runtime. Use a JMX console to set.
Boolean
Default: true
​

Attribute	Description	Data Type
key field	Key field to	String
fields	List of fields to track and determine changes	List<String>
emit only changes	A flag to emit only a delta event for the changes seen on the record. If set to false changes found will be will be added, as a map, to the `CDC_FIELD` event along with a `CDC` field being set to true to signify record availability.	Boolean Default: true
drop duplicates	Control flag which can be set to validate processor functionality at runtime. Use a JMX console to set.	Boolean Default: true

Processors - Previous

Triggers

Declarative Rules

Last modified 10mo ago