Apache Spark: Where Nothing Can Be Something
"Nothing is more real than nothing" - Samuel Beckett While working on an issue for a prospect’s proof of concept pipeline using StreamSets Transformer, a modern Spark ETL engine, I came across a perplexing bug. A certain column in the…