7d317bc0bc
Change-Id: I084c8d304d3568f0b918cc37f3ae65e1d5769ece
1.2 KiB
1.2 KiB
Running WordCount example from the Oozie command line
- Copy the
edp-java.jar
file fromsahara/edp-examples/edp-java
to./wordcount/lib/edp-java.jar
. - Modify the
job.properties
file to specify the correctjobTracker
andnameNode
addresses for your cluster. - Modify the
workflow.xml
file to contain the correct input and output paths. These paths may be sahara swift urls or HDFS paths.- If swift urls are used, set the
fs.swift.service.sahara.username
andfs.swift.service.sahara.password
properties in the<configuration>
section.
- If swift urls are used, set the
- Upload your
wordcount
directory to theoozie.wf.application.path
HDFS directory (theoozie.wf.application.path
directory is specified in thejob.properties
file):
$ hadoop fs -put wordcount oozie.wf.application.path
- Launch the job, specifying the correct oozie server and port:
$ oozie job -oozie http://oozie_server:port/oozie -config wordcount/job.properties -run
- Don't forget to create your swift input path! A sahara swift url
looks like
swift://container.sahara/object
.