openstack/deb-sahara
Code Issues Proposed changes
00af8bfc1a
deb-sahara/etc/edp-examples/edp-java/oozie_command_line
History
Trevor McKay 90187b0322 Create etc/edp-examples directory 
Merge content from sahara-extra/edp-examples and integration/tests/resources
into one directory under etc/edp-examples. This is part of the effort to
ultimately move edp-examples out of the sahara-extra repo and eliminate duplication.

The integration tests have been changed to reference the new
etc/edp-examples directory, and an EDPJobInfo class has been added to
eliminate path and config value duplication between the tests.

Partial-implements: blueprint edp-move-examples
Change-Id: I71b3cd21dcb9983fd6284a90316b12368481c700
2014-08-13 14:11:02 +00:00
..
wordcount Create etc/edp-examples directory 2014-08-13 14:11:02 +00:00
README.rst Create etc/edp-examples directory 2014-08-13 14:11:02 +00:00

README.rst

Running WordCount example from the Oozie command line

  1. Copy the edp-java.jar file from sahara/edp-examples/edp-java to ./wordcount/lib/edp-java.jar
  2. Modify the job.properties file to specify the correct jobTracker and nameNode addresses for your cluster.
  3. Modify the workflow.xml file to contain the correct input and output paths. These paths may be Sahara swift urls or hdfs paths.
    • If swift urls are used, set the fs.swift.service.sahara.username and fs.swift.service.sahara.password properties in the <configuration> section.
  4. Upload the wordcount directory to hdfs

$ hadoop fs -put wordcount wordcount

  1. Launch the job, specifying the correct oozie server and port

$ oozie job -oozie http://oozie_server:port/oozie -config wordcount/job.properties -run

  1. Don't forget to create your swift input path! A Sahara swift url looks like swift://container.sahara/object