By type

Filter events based on specific types from the processing pipeline

Objective

Filter events based on their type and subtype if declared.

Uses

There are various uses for this filter such as:

1. In quality assurance Ensure a stream performs as expected before results distribution by introducing deliberate errors to validate its function.

2. In data analytics When using Joule for metrics processing, remove events from the stream after logging them in the internal database to optimise resource use.

3. In IT and memory management Reduce memory usage by filtering to process only specific event types within a broader parent category, minimising unnecessary overhead.

Example & DSL attributes

This filter will exclude all events with type crypto and subtype ftx from the processing pipeline

type filter:
  type: crypto
  subtype: ftx
  exclude: true

Attributes schema

Attribute	Description	Data Type	Required
type	Event type	String
subtype	Event subtype	String
exclude	Flag to switch event exclusion	Boolean Default: true