Control Hub Requirements

StreamSets Control Hub has the following minimum requirements:

Component Minimum Requirement
Statistics aggregator Use one of the following systems to aggregate pipeline statistics when jobs run on multiple Data Collectors:
  • Amazon Kinesis Streams
  • Kafka version supported by Data Collector
  • MapR Streams version supported by Data Collector
Note: In a development environment, you can also use SDC RPC to aggregate pipeline statistics. Using SDC RPC to aggregate statistics is not highly available and might cause the loss of some data. It should be used for development purposes only.
StreamSets Data Collector StreamSets recommends using the latest version of Data Collector with Control Hub.
The minimum supported Data Collector version depends on how you use Data Collector:
  • Version 2.1.0.0 or later is required to design pipelines in Data Collector and to run standalone and cluster pipelines from jobs.
  • Version 3.0.0.0 or later is required as the authoring Data Collector used to design pipelines in the Control Hub Pipeline Designer.
  • Version 3.2.0.0 or later is required as the authoring Data Collector used to design pipeline fragments.
  • Version 3.4.0 or later is required to monitor the CPU load and memory usage of each Data Collector from within Control Hub.
  • Version 3.5.0 or later with the Data Protector stage library installed is required to use Data Protector.
StreamSets Data Collector Edge (SDC Edge) StreamSets recommends using the latest version of SDC Edge to run edge pipelines from jobs.

The minimum supported SDC Edge version is 3.0.0.0. Version 3.4.0 or later is required to monitor the CPU load and memory usage of each SDC Edge from within Control Hub.

Browser Use the latest version of one of the following browsers:
  • Chrome
  • Firefox
  • Safari