skip to Main Content

StreamSets Data Integration Blog

Where change is welcome.

Spark Streaming

Brenna Buuck By November 9, 2022

One crucial part of Big Data is streaming data. As the name suggests, streaming data refers to data that undergoes continuous generation from multiple sources like social media, CRM, and ERM platforms. Handling and analyzing streaming data can be complex,…

Create a Successful Data Migration Strategy

Brenna Buuck By September 26, 2022

A successful data migration strategy involves moving data from one source to another with as little friction as possible. That friction usually comes in cost, data loss, or downtime accessing the target or destination data sources. A good migration design…

A Deep Dive Into Data Pipeline Architecture

Brenna Buuck By September 21, 2022

With data-driven organizations 23 times more likely to acquire new customers and six times more likely to retain them, it’s no wonder most companies are shifting to a data-driven approach. This shift creates an ever-growing need for clean, current, and…

Data Integration Architecture

Brenna Buuck By September 6, 2022

An organization rarely has a single data source. Instead, it aggregates data from various sources like websites, applications, social media, and databases to make data easily accessible through data integration. In addition, this data needs to be transformed before being…

5 Best Practices for Building Data Pipelines

Brenna Buuck By August 24, 2022

Whether you are building your very first pipeline or you’re an old pro, these best practices for building data pipelines can help you make pipelines that are easy to understand and therefore easy to maintain and extend.   Design Data Pipelines…

AWS Reference Architecture Guide for StreamSets

Brenna Buuck By July 7, 2022

Using StreamSets DataOps Platform To Integrate Data from PostgreSQL to AWS S3 and Redshift: A Reference Architecture This document describes the reference architecture for integrating data from a database to Amazon Web Services (AWS) data analytics stack utilizing the StreamSets…

Back To Top