Telemetry auditing

Audit and track events for validation and testing

Overview

Joule provides a build in telemetry auditing feature, which records inbound and outbound events to support testing, model validation, retraining and other analyses.

The auditing process logs events into an in-memory SQL database at set intervals, allowing users to capture both raw incoming events and processed outgoing events.

This feature is optional, it allows the users to configure it based on specific needs

Example & DSL attributes

This example will write every inbound and outbound event to the in-memory database every 10 seconds using cloned events for inbound and the resulting event from the final processing step.

Inbound events are defined as raw and outbound as processed.

stream:
  ...
  telemetry auditing:
    raw:
      clone events: true
      frequency: 10
    processed:
      clone events: false
      frequency: 10

Attributes schema

Attribute	Description	Data Type	Required
clone events	Flag to inform the platform to perform a deep copy of the event	Boolean Default: false
frequency	Frequency in seconds to write events to the internal in-memory database. Setting must be greater or equal to 5 seconds	Integer Default: 5 Secs