Joule provides the ability to tap an event stream in to an in-process / memory database. This feature is useful to gain data in SQL format for addtional purposes such as off-line analytic. Combining this feature with the provided Rest API functionality it becomes a powerful feature.
target schema: nasdaq_quotes
queue capacity: 15000
flush frequency: 5
On processor initialisation a set of queries are auto generated which are used to bind Rest API endpoints. The following queries are generated:
Select data using pagnation either with or without an ingestTime date range.
Ability to export the table either by CSV or Parquet formats.
Query to delete rows from the table between an ingestTime date range.