Videos

May the 4th Be With You – Analyzing Star Wars Twitter Mentions in Minecraft

Arena - high angleA couple of weeks ago, as May the 4th approached, a lively Star Wars debate brewed at StreamSets:

  • “Do new school characters get as much play as old favorites like Darth Vader, Yoda and Han Solo?”
  • “Does the Dark Side of the Force dominate the Light?”
  • “Does Yoda prevail over Darth Vader?”

It occurred to us that, with the Twitter Streaming API and StreamSets Data Collector, we didn’t have to guess or debate. We built a data flow that ingested and analyzed tweets and then displayed them in … Minecraft!

Pat PattersonMay the 4th Be With You – Analyzing Star Wars Twitter Mentions in Minecraft
Read More

Visualizing Apache Log Data… with Minecraft!

Apache log data in MinecraftA key differentiator of StreamSets Data Collector (SDC) is that it operates in continuous mode – set a pipeline running and it will continue to read files from a directory or take messages from a queue. A Twitter conversation with Richard Tuttle, a solution architect at CRM Science, prompted me to wonder, would it be possible to ingest Apache Web Server log data, lookup the geolocation from the client IP address, and plot the results on a map… in Minecraft?

Pat PattersonVisualizing Apache Log Data… with Minecraft!
Read More

Using Open Source StreamSets to Tackle Data Drift (video)


Watch StreamSets Field Engineer Jonathan “Natty” Natkins demonstrate how you can use the open source StreamSets Data Collector to flexibly handle painful “data drift” – the inevitable evolution of infrastructure, semantics and schema that leads to corrupted data and broken pipelines.

 
Download Open Source StreamSets Data Collector at www.streamsets.com/opensource.
Rick BilodeauUsing Open Source StreamSets to Tackle Data Drift (video)
Read More