Monitoring Transformers

When you view registered Transformers in the Execute view, you can monitor the performance of each Transformer and the pipelines currently running on each Transformer.

To monitor a Transformer, simply expand the Transformer details in the Execute > Transformers view.

Tip: You can also monitor Transformers by creating a subscription that automatically notifies you when a registered Transformer stops responding.

Performance

When you view the details of a Transformer in the Execute view, you can monitor the performance of the Transformer.

Control Hub displays the following performance information for Transformers:
CPU Load
Percentage of CPU being used by the Transformer.
Memory Used
Amount of memory being used by the Transformer out of the total amount of memory allocated to that Transformer.
For example, let's say that a Transformer displays the following value for Memory Used:
216.36 MB of 1038.88 MB
That means that the Transformer is using 216.36 MB out of the total 1038.88 MB of memory allocated to that Transformer in the Java heap size. You configure the Transformer Java heap size in the TRANSFORMER_JAVA_OPTS environment variable.

You can sort the list of Transformers by the CPU load or by the memory usage so that you can easily determine which Transformers are using the most resources.

You can also analyze historical time series charts for the CPU load and memory usage. For example, you can view the performance information for the last hour or for the last seven days. The following image displays the location where you select a time period for analysis of the charts:

By default, registered Transformers send the CPU load and memory usage to Control Hub every minute. You can change the frequency with which each Transformer sends this information to Control Hub by modifying the dpm.remote.control.status.events.interval property in the Control Hub configuration file, $TRANSFORMER_CONF/dpm.properties.

Pipeline Status

When you view the details of a Transformer in the Execute view, Control Hub displays the list of pipelines currently running on this Transformer.

Control Hub can display the following types of running pipelines for each Transformer:

Local pipelines
A local pipeline is a test run of a draft pipeline or is a pipeline that is managed by a Transformer and run locally on that Transformer.
Control Hub controlled pipelines
A Control Hub controlled pipeline is a pipeline that is managed by Control Hub and run remotely on registered Transformer. Control Hub controlled pipelines are published pipelines run from Control Hub jobs.
After you publish or import pipelines to Control Hub, you add them to a job, and then start the job. When you start a job on a Transformer, Control Hub remotely runs an instance of the published pipeline on the Transformer. Use Control Hub to start, stop, and monitor published pipelines that are run from jobs.