Our thoughts, knowledge, insights and opinions

Posts tagged as “Spark”

Introduction to Machine Learning with Spark and MLlib (DataFrame API)

An introduction to the Scala Spark MLlib (DataFrame API) Machine Learning library.

by Marcin Gorczyński
October 12, 2017
Tags : Scala Spark Machine Learning

Extending Spark pipeline

Spark provides many built-in transformers for its Pipeline API. But what if you want something that is unavailable out of the box? You need to extend the Pipeline with your own transformer.

by Tomasz Sosiński
December 1, 2016
Tags : Scala Spark MLlib

Apache Spark 101

Apache Spark by example. Introduction and solving an example problem

by Patryk Jażdżewski
February 4, 2016
Tags : Spark Scala