The DataOps Blog
Where Change Is Welcome
The Next Chapter for StreamSets
Arvind Prabhakar and I co-founded StreamSets in 2014 with an audacious vision: data should be the lifeblood of the enterprise.…
The 4 Best Data Integration Tools to Consider for 2022
We all know that data is the compass rose for business operations. From enabling marketing to fostering innovative design, data is the bedrock that allows companies to deliver innovative solutions to the marketplace. And much like every other aspect of business operations, using data to enhance business processes has become more sophisticated and complex because of today’s technology-rich landscape. As…
The Difference Between Data Governance and Data Management
Every day, business is becoming more dependent on data. From reports stating that the world’s data volume will grow by 40% per year to those that predict data analytics market growth of 13.54% CAGR, it's safe to say that data is and will continue to be central to business. And while data and business become ever more interdependent, it’s understandable…
What You Need to Know About Kafka Stream Processing in Python
Instant notifications, product recommendations and updates, and fraud detection are practical use-cases of stream processing. With stream processing, data streaming and analytics occur in real-time, which helps drive fast decision-making. However, building an effective streaming architecture to handle data needs can be challenging because of the multiple data sources, destinations, and formats involved with event streaming. The Basics of Apache…
Microsoft SQL Server Replication: Change Tracking in Action
There are a couple of different approaches to SQL Server replication. I’ve always taken the common approach, one you’re likely very familiar with, Change Data Capture (CDC). In fact, I’ve written guides on CDC replication of other databases using StreamSets and how we do it with Microsoft SQL Server is very similar. However, about a year ago I heard about…
Gain More Value Out of Streaming Data with Reusable Connectors
No one can argue the value streaming data provides for an organization. From analyzing data while in motion, it’s no surprise that data-driven organizations are incorporating it into their overall data processes to help identify business strategies that work and those that don’t. As a result, the streaming analytics market has a projected growth of USD 191.72 billion and a…