sparkexamples - Tumblr blog

[sparkexamples]

Pretty good PySpark GroupBy examples

[sparkexamples]

Joins in Spark

[sparkexamples]

Interesting challenge of using an array of strings to filter a Spark Stream

[sparkexamples]

Spark WAL

Spark Streaming includes the option of using Write Ahead Logs or WAL to protect against failures.  A Write Ahead Logs (WAL) is like a journal log. A WAL structure enforces fault-tolerance by saving all data received by the receivers to logs file located in checkpoint directory. 

WAL is enabled through spark.streaming.receiver.writeAheadLog.enable property.

[sparkexamples]

Tutorial post with history and options when building spark streaming with Kafka.  Includes sample code and screencasts

[sparkexamples]

Not a Spark related article but I had to post this article on monads in Scala

[sparkexamples]

#spark #apachespark

[sparkexamples]

An overview of Spark Streaming

[sparkexamples]

A coupon link for significant discount to Apache Spark course on Udemy