The DataOps Blog
Where Change Is Welcome
The Difference Between Data Governance and Data Management
Every day, business is becoming more dependent on data. From reports stating that the world’s data volume will grow by 40% per year to those that predict data analytics market growth of 13.54% CAGR, it's safe to say that data is and will continue to be central to business. And while data and business become ever more interdependent, it’s understandable…
What You Need to Know About Kafka Stream Processing in Python
Instant notifications, product recommendations and updates, and fraud detection are practical use-cases of stream processing. With stream processing, data streaming and analytics occur in real-time, which helps drive fast decision-making. However, building an effective streaming architecture to handle data needs can be challenging because of the multiple data sources, destinations, and formats involved with event streaming. The Basics of Apache…
Microsoft SQL Server Replication: Change Tracking in Action
There are a couple of different approaches to SQL Server replication. I’ve always taken the common approach, one you’re likely very familiar with, Change Data Capture (CDC). In fact, I’ve written guides on CDC replication of other databases using StreamSets and how we do it with Microsoft SQL Server is very similar. However, about a year ago I heard about…
Gain More Value Out of Streaming Data with Reusable Connectors
No one can argue the value streaming data provides for an organization. From analyzing data while in motion, it’s no surprise that data-driven organizations are incorporating it into their overall data processes to help identify business strategies that work and those that don’t. As a result, the streaming analytics market has a projected growth of USD 191.72 billion and a…
Driving Innovation in the Data Cloud: StreamSets Announces General Availability of Transformer for Snowflake
Convergence is a beautiful thing, when two forces that were traditionally at odds begin to coexist and complement to create something unique. For so many years the rift between the reliable and useful confines of SQL and the complete control of advanced order coding was a forcible design choice. For companies where standard SQL was working, there remained hesitation to…
