How Trend Micro Uses StreamSets – An Interview with the Threat Research Team
The DataOps Blog
Where Change Is Welcome
Binlog Processing Using Maxwell, Kafka & StreamSets
This is a nice example of Kafka enablement using Maxwell (a mysql-to-kafka binlog processor) and StreamSets Data Collector from the folks at B23. It includes a schema change listener for handling data drift. Enjoy! Innovate on Your Data - Maxwell…
Simple Kafka Enablement Using StreamSets (video)
You can simplify use of Kafka within your infrastructure using StreamSets Data Collector. Watch this short step-by-step tutorial to learn how.
Continuous Ingest to Elasticsearch (video)
You can send log files to Elasticsearch using StreamSets Data Collector. Watch this short step-by-step to see how.
StreamSets Monitoring with Grafana, InfluxDB, and jmxtrans
The ability to monitor your critical infrastructure is a must, and we designed the StreamSets Data Collector (SDC) with this in mind: metrics are exposed through both the REST API and JMX. While there are many approaches to monitoring these metrics, let’s walk through a specific end-to-end example using jmxtrans to collect metrics, InfluxDB to store them, and Grafana to visualize them.
Ingesting Streaming Data from JMS into HDFS and Solr using StreamSets
Now we’ll start publishing messages to a JMS queue. They are simple text messages with random words. Periodically the program outputs two types of bad records. Records without an id message header and records with empty content. We will use…