deb-sahara/etc/edp-examples/edp-spark
Trevor McKay bab13bc26d Add Spark integration test
This integration test includes spinning up a cluster, running an EDP
job, and deleting the cluster.  Cluster scaling is not included
currently.

The Spark example included is SparkPi.

Implements: blueprint edp-spark-integration-tests
Change-Id: I9cdb3ab29d3364024f5cbe42b3cf4bae398cd547
2014-08-18 11:02:39 -04:00
..
NOTICE.txt Add Spark integration test 2014-08-18 11:02:39 -04:00
README.rst Add Spark integration test 2014-08-18 11:02:39 -04:00
spark-example.jar Add Spark integration test 2014-08-18 11:02:39 -04:00

Example Spark Job

This example contains the compiled classes for SparkPi extracted from the example jar distributed with Apache Spark version 1.0.0.

SparkPi example estimates Pi. It can take a single optional integer argument specifying the number of slices (tasks) to use.