Wordcount

The "Hello World" of MapReduce, implemented in Scala using Apache Spark.

Prerequisites

• Install Scala 2.10:

  wget http://www.scala-lang.org/files/archive/scala-2.10.4.deb
  sudo dpkg -i scala-2.10.4.deb

• Install sbt (tested with v0.13.5):

  wget http://dl.bintray.com/sbt/debian/sbt-0.13.5.deb
  sudo dpkg -i sbt-0.13.5.deb

• Install Spark 1.0:

  wget http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop2.tgz
  tar -xzf spark-1.0.0-bin-hadoop2.tgz
  cd spark-1.0.0-bin-hadoop2
  export SPARK_HOME=$(pwd)
  export PATH="$PATH $SPARK_HOME/bin"

Usage

cd /path/to/project

sbt package

spark-submit --class "App" target/app-1.0.jar