Getting started

Overview

What this tutorial is about

This tutorial aims to teach how to run a real-time banking example with your first Joule.

Who this tutorial is intended for

We have tailored this tutorial for anyone who wants to learn how to use Joule for the first time and who wishes to learn how to deploy a first use case given that your environment is setup already.

What we will learn

By the end of this tutorial, we will have learned:

1. How to start and stop Joule.

2. Deploy a first real-time use case.

3. Access the Redpanda interface to see the deployed use case in action.

Prerequisites

1. Understanding of how to navigate with the command line through directories. Not sure how to navigate with command line? Follow this tutorial.

2. Java is installed. Don’t have Java? Follow this tutorial.

3. Postman is installed. Don’t have Postman? Follow this tutorial.

4. Redpanda is installed. Don’t have Redpanda? Follow this tutorial.

5. Docker or any other alternative to run containers.

6. Git is installed. Don’t have Git? Follow this tutorial.

Step 1 - We will start up our environment

The following steps will guide us on setting up our environment to deploy our images and containers with Joule.

1. We will clone the repository with this command.

git clone 
https://gitlab.com/joule-platform/fractalworks-stream-gettingstarted/

2. Once cloned, we will checkout to dev.

git checkout dev

3. We will navigate to the quickstart directory.

4. We will make sure that Docker or our alternative is running.

We are now ready to start building Joule. To start Joule, we need to run the following command which will start building our images and containers.

./startupJoule.sh

The command will start up the following containers ready for use case deployment:

• Joule Daemon

• Joule Database

• Redpanda

We should expect this output

Step 2 - We will run the Getting Started example

The banking demo directories provides a set of examples in the form of a postman collection and environment. These can be found under the examples directory.

We will now get started running the banking Getting Started demo example using Postman.

1. First we will import the use case demos and environment files from the banking-demo examples directory.

2. We will set the Postman environment to Joule.

3. From the Getting started \ Deploy folder click Run folder from the menu.

4. Finally execute the run order by clicking the Run Joule - Banking demo button.

This will deploy the source, stream, sink and the use case binding definition to the platform.

We should expect this output

Step 3 - Next we will start the quote publisher

The banking demo is provided with a quote simulator which is seeded using

./bin/startQuotePublisher.sh

This command will generate a continuous set of quote and publish them to the quotes topic. We will see how to access the topic on the next step.

We should expect this output

Press return to continue.

Step 4 - We will now review our use case outputs

Once the processing pipeline completes its tasks, the resulting events are published on to the analytics_view topic ready for further consumption (i.e. distribution, dashboard, dynamic portfolio risk measures etc).

To learn how to navigate the interface, look at this tutorial.

We should expect this output

Step 5 - We will stop the quotes simulator

Once we are ready to shut down Joule, we will first stop the quotes publisher by executing the command below.

./bin/stopQuotePublisher.sh

We can now undeploy the use case and its linked components by executing the Run Joule - Banking demo under the Undeploy use case folder.

In case we want to execute complete shut down of Joule, we can instead follow the steps below.

We should expect this output

Step 6 - We will shut the environment down

Once quotes publisher has been stopped the Joule environment can now be shutdown. We have 2 options to shut Joule down.

./shutdownAndCleanJoule.sh

./shutdownJoule.sh

What did we learn?

We covered essential steps to run our first Joule including cloning the repository and running a first streaming banking use case via Postman.

In summary we have learned:

1. How to publish continuous data streams with the quote simulator.

2. How to see our use case in execution in the Redpanda interface.

3. How to review and process analytics outputs through our default use case.

4. How to stop, shut down the Joule environment and clean up the system.

What’s next?

Now that we have learned the basics about Joule, it is time to learn how to create our own use case.