The DataOps Blog
Where Change Is Welcome
What You Need to Know About Kafka Stream Processing in Python
Instant notifications, product recommendations and updates, and fraud detection are practical use-cases of stream processing. With stream processing, data streaming and analytics occur in real-time, which helps drive fast decision-making. However, building an effective streaming architecture to handle data needs can be challenging because of the multiple data sources, destinations, and formats involved with event streaming. The Basics of Apache…
Microsoft SQL Server Replication: Change Tracking in Action
There are a couple of different approaches to SQL Server replication. I’ve always taken the common approach, one you’re likely very familiar with, Change Data Capture (CDC). In fact, I’ve written guides on CDC replication of other databases using StreamSets and how we do it with Microsoft SQL Server is very similar. However, about a year ago I heard about…
Gain More Value Out of Streaming Data with Reusable Connectors
No one can argue the value streaming data provides for an organization. From analyzing data while in motion, it’s no surprise that data-driven organizations are incorporating it into their overall data processes to help identify business strategies that work and those that don’t. As a result, the streaming analytics market has a projected growth of USD 191.72 billion and a…
Driving Innovation in the Data Cloud: StreamSets Announces General Availability of Transformer for Snowflake
Convergence is a beautiful thing, when two forces that were traditionally at odds begin to coexist and complement to create something unique. For so many years the rift between the reliable and useful confines of SQL and the complete control of advanced order coding was a forcible design choice. For companies where standard SQL was working, there remained hesitation to…
Snowpark UDFs: Transform Your Data More Efficiently with Python
You may be taking an interest in Snowpark UDFs as a way to take full advantage of the power of your Snowflake Data Cloud. You’re not alone. Companies are always looking for new ways to get more out of their existing investments, simplify and standardize on technologies that can help them scale and support company growth. No matter what stage…
