Filters
Reduce stream processing overhead by filtering irrelevant events
Overview
Filters are the foundational component to manage incoming events.
This is a technique that removes irrelevant or sensitive data from a stream by evaluating each element with pre-set conditions. Filters aim to improve processing efficiency, especially when only a subset of the data is needed for your use case.
These filters allow you a variety of options such as filtering event based using a configurable criteria or a custom expression.
Use cases
Managing customer opt-outs.
Addressing missing data elements.
Handling PII data.
Handling out-of-range values.
Available options
By type
Filter events based on specific types from the processing pipeline
By expression
Use Javascript expressions to define custom filters.
On delta
Stateful filter processor that filters previous seen events
Remove attributes
Remove sensitive attributes from an event
Drop all
Drop all incoming events in the processor
Last updated