Our thoughts, knowledge, insights and opinions

Posts by Tomasz Sosiński

Programming enthusiast partial to functional programming and Scala with expertise in R and Python; fascinated by data (big and fast) and the ability to tell stories with information. Recommendation systems, machine learning and BigData application are fuel for his motivation. While searching for new challenges, he meanders from rendering infographics to core data transformations. Photography lover, eager biker and a huge fan of Asaf Avidan.

Extending Spark pipeline

Spark provides many built-in transformers for its Pipeline API. But what if you want something that is unavailable out of the box? You need to extend the Pipeline with your own transformer.

by Tomasz Sosiński
December 1, 2016
Tags : Scala Spark MLlib