skip to Main Content

The DataOps Blog

Where Change Is Welcome

Why & How to Use Data Enrichment to Activate Your Data Lake for Analytics

Use Cases, Industry

We all know the shift to the cloud is massive and has been accelerated by COVID; however, I think many of us (myself included) don’t take enough time to really look at the new cloud-native services for doing data enrichment and analytics. AWS Re:Invent last December was a great opportunity to talk to customers, prospects, and other technology companies. Meeting…

By March 8, 2022

Transformer for Snowflake: Snowflake Transformation that Meets Cloud-First Expectations

Use Cases, StreamSets Partners

Transformer for Snowflake is the first enterprise data transformation engine built on Snowpark. Want to learn how the engine makes advanced, native data transformations for your Data Cloud possible? Join our technical experts on Office Hours. It's likely you remember (or have at least heard) that databases in the past, beyond SQL, were extremely complicated to stay in a performant…

By February 3, 2022

The JSON Validator: A Custom Processor to Ensure Your JSON Payload is Syntactically Accurate

Use Cases

Before we get to building your custom JSON validator, let’s talk about the author and their thoughts on why JSON has become so essential in data engineering. The author, Joel Klo, is a consultant at Bigspark, UK's engineering powerhouse, delivering next level data platforms and solutions to their clients. Their clients use modern cloud platforms and open source technologies, prioritize…

By January 25, 2022

Get Ready for Private Preview! Transformer Engine for Snowflake

StreamSets News, StreamSets Partners

Transformer for Snowflake is the first enterprise data transformation engine built on Snowpark. Want to learn how the engine makes advanced, native data transformations for your Data Cloud possible? Join our technical experts on Office Hours. It’s no surprise when organizations implement the Snowflake Data Cloud as their internal standard for their overall data strategy. Especially as Snowflake continues to…

By December 21, 2021

Manage File Updates with Automated Drift Detection in Your Kafka Topics

Use Cases

This article is the second part of a three-part series, Conducting the Chaos of Data Drift. StreamSets’ automated drift detection, a piece of it’s patented Data Drift technology, allows users to reduce break-fix by 90%. In this second part of the series, we will be covering explicitly data drift as it pertains to Kafka Topics.  Read Part One: Manage File…

By November 17, 2021
Back To Top