bab13bc26d
This integration test includes spinning up a cluster, running an EDP job, and deleting the cluster. Cluster scaling is not included currently. The Spark example included is SparkPi. Implements: blueprint edp-spark-integration-tests Change-Id: I9cdb3ab29d3364024f5cbe42b3cf4bae398cd547
9 lines
294 B
ReStructuredText
9 lines
294 B
ReStructuredText
Example Spark Job
|
|
=================
|
|
|
|
This example contains the compiled classes for SparkPi extracted from
|
|
the example jar distributed with Apache Spark version 1.0.0.
|
|
|
|
SparkPi example estimates Pi. It can take a single optional integer
|
|
argument specifying the number of slices (tasks) to use.
|