Bringing DevOps Agility
to Data Integration

Starting with a Purpose

In 2014, an ex-Cloudera engineering leader and ex-Informatica product leader clicked on a difficult problem they had both witnessed first-hand. They realized that big and fast data was breaking the traditional data integration paradigm based on structured data and stable data movement patterns. With help from some gifted engineers they architected a new way of moving data based on the assumption of continuous data and frequent change. And StreamSets was born.

The StreamSets DataOps platform enables the agile design and operation of continuous data movement architectures that connect traditional and big data sources to analytics platforms and applications. At its core is StreamSets Data Collector, an open source data movement engine with well over 2 million downloads.

On top of this “open core” are commercial products that enable collaborative design, deployment and runtime management of data movement architectures at enterprise scale. In 2017, our customer base tripled and our revenue grew fourfold. We have been named a Gartner Cool Vendor in Data Management and a Fortune Great Place to Work.

Fortune 100 Downloads
Downloads
Customer Growth 2017
ARR Growth 2017

Challenge

The Exploding Data Supply Chain

To win with data, companies must enable pervasive intelligence, empowering every corner of their business to analyze and act on all available data, on-demand. But the “data supply chain” has exploded, with a growing and shifting variety of data sources and storage/compute platforms being put to use for general-purpose data science as well as specific initiatives such as cybersecurity, IoT and customer 360.

This dynamic sprawl of technology makes it resource-intensive to design reliable data movement architectures. Moreover, the exploding supply chain creates data drift, unexpected flux in data formats and semantics that break pipelines and pollute data integrity.

Solution

Embracing DataOps is Key

To master the modern data supply chain, enterprises need to adopt DataOps, an agile and iterative process for managing data movement. In the same way that DevOps enables continuous delivery of applications, DataOps allows enterprises to operate data movement architectures that frequently iterate in response to changing infrastructure, data sources and analytics requirements.

A DataOps Platform Enables Pervasive Intelligence

To make it easier to be agile, StreamSets built the industry’s first DataOps platform. With it, enterprises can develop and operate data movement architectures that span edge devices, data center platforms and multiple clouds to bring about the vision of pervasive intelligence.

The platform enables companies to:

  • Build dataflows 10 times faster with 1/10 the resource
  • Move data continuously with end-to-end visibility and control
  • Enforce dataflow performance through Data SLAs
  • Iterate pipelines and topologies through a central hub

Intelligent Pipelines

The platform is architected with Intelligent Pipelines that inspect and learn from the data as it passes. This provides numerous benefits, such as the automatic handling of data drift, and the detection and securing of sensitive data in-stream for improved regulatory compliance.

Learn More

Watch the short video to see the StreamSets DataOps approach (DevOps for data management and integration).

Customers

Commercial customers include dozens of Fortune 500 companies across banking, energy, financial services, healthcare, insurance, manufacturing, media, retail, technology and telecommunications.
StreamSets had 3-fold customer growth and 4-fold ARR growth in 2017.

0
x CUSTOMER GROWTH
0
x ARR GROWTH

Recognition

Fortune Great Places to Work 2017 Small and Medium Companies
Gartner_Cool_Vendor_2017-k
Red-Herring-100-Winner-2018-North-America-k
CRN Big Data 100 Logo
2017 Best Places to Work - Bay Area
TIE50 logo

Investors

Ignition
Data Collective
Accel Partners
Battery Ventures
New Enterprise Association
Schedule a Demo
Receive Updates

Receive Updates

Join our mailing list to receive the latest news from StreamSets.

You have Successfully Subscribed!

Pin It on Pinterest