bab13bc26d
This integration test includes spinning up a cluster, running an EDP job, and deleting the cluster. Cluster scaling is not included currently. The Spark example included is SparkPi. Implements: blueprint edp-spark-integration-tests Change-Id: I9cdb3ab29d3364024f5cbe42b3cf4bae398cd547
294 B
294 B
Example Spark Job
This example contains the compiled classes for SparkPi extracted from the example jar distributed with Apache Spark version 1.0.0.
SparkPi example estimates Pi. It can take a single optional integer argument specifying the number of slices (tasks) to use.