com.conversantmedia.mapreduce.example

Class PrepareInputsExample

java.lang.Object

org.apache.hadoop.conf.Configured

com.conversantmedia.mapreduce.example.PrepareInputsExample

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

@Driver(value="prepare-inputs")
public class PrepareInputsExample
extends org.apache.hadoop.conf.Configured

In this example we will do some pre-processing on the inputs (copy to a 'working' directory) before kicking off the job.

Constructor Summary

Constructors

Constructor and Description
PrepareInputsExample()

Method Summary

Modifier and Type	Method and Description
void	cleanup()
void	copyFilesToWorking()
org.apache.hadoop.fs.Path	getWorkingDirectory()

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PrepareInputsExample

public PrepareInputsExample()

Method Detail

copyFilesToWorking

@DriverInit
public void copyFilesToWorking()
                                    throws IOException

Throws:

IOException

cleanup

@DriverCleanup
public void cleanup()
                            throws IOException

Throws:

IOException

getWorkingDirectory

public org.apache.hadoop.fs.Path getWorkingDirectory()