Release Notes

What's New

The following sections list the new features and improvements in each release of StreamSets Cloud.

February 24, 2020

This release includes the following new stage:
  • Databricks Delta Lake executor - Runs one or more Spark SQL queries on a Delta Lake table on Databricks each time it receives an event record. Use the executor to bulk load data into a Delta Lake table or to merge changed data into a Delta Lake table. The executor requires a Databricks cluster version 6.3 or later.

February 3, 2020

This release includes the following improvement:
  • The pipeline run log is now viewable for a pipeline that has recently finished. Previously, the run log was viewable only for an active pipeline run.

January 21, 2020

This release includes the following new stage:

January 13, 2020

Origins
This release includes the following new origin:
  • Oracle CDC Client - Reads LogMiner redo logs to generate change data capture records.
Processors
This release includes the following new processors:
  • Field Pivoter - Pivots data in a list, map, or list_map field and creates a record for each item in the field.
  • Field Zip - Merges list data from two fields.
SSH tunneling for database connections
You can now configure pipeline stages that access databases to use an SSH tunnel to securely connect to the database. When you use an SSH tunnel, the stage uses an encrypted connection without requiring any changes to the database.

December 12, 2019

This release fixes the following known issue:
  • The Azure SQL Data Warehouse destination cannot connect to Azure SQL Data Warehouse due to a Microsoft API change.