The DataOps Blog
Where Change Is Welcome
Manage File Updates with Automated Drift Detection in Your Kafka Topics
This article is the second part of a three-part series, Conducting the Chaos of Data Drift. StreamSets’ automated drift detection, a piece of it’s patented Data Drift technology, allows users to reduce break-fix by 90%. In this second part of the series, we will be covering explicitly data drift as it pertains to Kafka Topics. Read Part One: Manage File…
Snowflake and StreamSets’ Partnership Means Accelerated Innovation for the Future of Data Integration
Data. It makes the world go round. An overstatement perhaps, but in some pockets of the globe you wouldn’t know it by the glacial pace of modernization. Modern organizations of all sizes today rely on data to fuel smart decision-making. And an increasing number of them rely on the Snowflake Data Cloud platform to democratize data access and bring increased…
Manage File Updates with Automated Drift Detection in Your Snowflake Ingest Pipelines
This article is the first part of a three-part series, Conducting the Chaos of Data Drift. StreamSets’ automated drift detection, a piece of it’s patented Data Drift technology, allows users to reduce break-fix time by 90%. In this first part of the series, we will be covering explicitly data drift as it pertains to files being pushed into Snowflake or…
Why Data Engineering Is The Future of Data
As I was preparing my session for the recent DataOps Summit, I realized once again that data engineering is the future of data. More than that, those data engineers who rely on DataOps will lead the way. In this blog, as I did in my session, I will share why I believe that so strongly. The Evolution to Modern Data…
Sources and Destinations Podcast Episode #8 Keith Gaputis
This week we are happy to host Keith Gaputis. Keith is the Data Engineering Lead at Axis Group. Axis Group is a longtime StreamSets partner and friend to the field. Keith joins us to talks about cloud, containers, and working on functional teams across engineering and data science. Be sure to check out Keith’s talk at DataOps Summit as he…