Commit c3aacfb6 authored by jiongzhu's avatar jiongzhu
Browse files

Add input and wordcount scripts

parent b51868f4
The Victors (L. Elbel) / Regents of the University of Michigan
Now for a cheer they are here, triumphant!
Here they come with banners flying,
In stalwart step they are nighing,
With shouts of victory crying,
We hurrah, hurrah, we greet you now,
Hail!
Far we their praises sing
For the glory and fame they have brought us
Loud let the bells them ring
For here they come with banners flying
Far we their praises tell
For the glory and fame they have brought us
Loud let the bells them ring
For here they come with banners flying
Here they come, Hurrah!
Hail! to the victors valiant
Hail! to the conquering heroes
Hail! Hail! to Michigan
the leaders and best
Hail! to the victors valiant
Hail! to the conquering heroes
Hail! Hail! to Michigan,
the champions of the West!
We cheer them again
We cheer and cheer again
For Michigan, we cheer for Michigan
We cheer with might and main
We cheer, cheer, cheer
With might and main we cheer!
Hail! to the victors valiant
Hail! to the conquering heroes
Hail! Hail! to Michigan,
the champions of the West!
#!/bin/bash
dirname="$(dirname "$0")" # Get script directory
hadoop_queue_name="default"
set -x # Below this line, each command will be printed to terminal before being executed.
hdfs dfs -mkdir -p hadoop_examples/wordcount/input/
hdfs dfs -put input.txt hadoop_examples/wordcount/input/
hdfs dfs -rm -r hadoop_examples/wordcount/output/
yarn jar $dirname/hadoop-streaming.jar \
-input hadoop_examples/wordcount/input \
-output hadoop_examples/wordcount/output \
-mapper map.py \
-reducer red.py \
-file map.py \
-file red.py \
-jobconf mapred.job.queue.name=$hadoop_queue_name
......@@ -15,4 +15,4 @@ else
echo " e.g. $0 2.6.3"
echo "Choices:"
ls $dirname/bin/*.jar
fi
\ No newline at end of file
fi
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment