Times are definitely not “normal”, and more challenging for some than others, but I hope everyone is continuing to stay safe and I wish everyone a very happy holiday season. More importantly, I also want to take this opportunity and thank our community members and customers because despite what might have been going on in everyone’s lives during this pandemic, together we have had some wins that should be celebrated.
Highlights
Here are some of the highlights with regards to StreamSets products, technical content and resources made available for data engineers in the year 2020.
- We published 39 technical blogs. That’s over 3 blogs a month — which is incredible! These blogs were contributed not only by StreamSets authors, but some of them were also written by our customers. Among the top performing blogs were 13 Data Engineering Best Practices At DNB and COVID-19 Open Research Dataset Analysis on StreamSets DataOps Platform.
- Between StreamSets Data Collector, a fast ingestion engine, and StreamSets Transformer, a modern Spark ETL engine, we released a total of 16 new versions that included many new features, enhancements and bug fixes. One of the most important new features released was Connection Catalog for Secure Data Access.
- We hosted a total of 14 webinars to introduce new product features, highlight our customers and their use cases, and to share best practices and design patterns for building smart data pipelines.
- We published several white papers including a Data Engineer’s Handbook that describes what smart data pipelines are, why data engineers need them, and highlights 4 key data pipelines to make data ingestion and transformation in the cloud a breezy success.
- We launched a monthly hands-on, “no-slides” show StreamSets Live: Demos with Dash which has been a great pleasure to host to demonstrate various technical aspects of the StreamSets DataOps Platform.
- To help users quickly get started with building data pipelines, we created 28 snackable how-to videos and launched StreamSets Snackathon, a data engineering contest for data engineers and by data engineers.
Lastly, none of this would have been possible without the help, support and feedback from you — our customers and community members. So, thank you!
Here’s to a great 2021!