openstack
/
sahara-tests
Code Issues Proposed changes
sahara-tests/sahara_tests/scenario/defaults/edp-examples/edp-java/oozie_command_line/README.rst

1.2 KiB
Raw Blame History

Running WordCount example from the Oozie command line

  1. Copy the edp-java.jar file from sahara/edp-examples/edp-java to ./wordcount/lib/edp-java.jar.
  2. Modify the job.properties file to specify the correct jobTracker and nameNode addresses for your cluster.
  3. Modify the workflow.xml file to contain the correct input and output paths. These paths may be sahara swift urls or HDFS paths.
    • If swift urls are used, set the fs.swift.service.sahara.username and fs.swift.service.sahara.password properties in the <configuration> section.
  4. Upload your wordcount directory to the oozie.wf.application.path HDFS directory (the oozie.wf.application.path directory is specified in the job.properties file):

$ hadoop fs -put wordcount oozie.wf.application.path

  1. Launch the job, specifying the correct oozie server and port:

$ oozie job -oozie http://oozie_server:port/oozie -config wordcount/job.properties -run

  1. Don't forget to create your swift input path! A sahara swift url looks like swift://container.sahara/object.