作者:Mua--于毛毛在路上 | 来源:互联网 | 2023-08-12 15:53
本文整理了Java中org.apache.hadoop.mapred.JobConf.getMapRunnerClass()
方法的一些代码示例,展示了JobConf.getMapRunnerClass()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JobConf.getMapRunnerClass()
方法的具体详情如下:
包路径:org.apache.hadoop.mapred.JobConf
类名称:JobConf
方法名:getMapRunnerClass
JobConf.getMapRunnerClass介绍
[英]Get the MapRunnable class for the job.
[中]获取作业的MapRunnable类。
代码示例
代码示例来源:origin: org.apache.tez/tez-mapreduce
void runOldMapper(
final JobConf job,
final MRTaskReporter reporter,
final MRInputLegacy input,
final KeyValueWriter output
) throws IOException, InterruptedException {
// Initialize input in-line since it sets parameters which may be used by the processor.
// Done only for MRInput.
// TODO use new method in MRInput to get required info
//input.initialize(job, master);
InputSplit inputSplit = input.getOldInputSplit();
updateJobWithSplit(job, inputSplit);
RecordReader in = new OldRecordReader(input);
OutputCollector collector = new OldOutputCollector(output);
MapRunnable runner =
(MapRunnable)ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
runner.run(in, collector, (Reporter)reporter);
// Set progress to 1.0f if there was no exception,
reporter.setProgress(1.0f);
// start the sort phase only if there are reducers
this.statusUpdate();
}
代码示例来源:origin: com.facebook.hadoop/hadoop-core
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: org.jvnet.hudson.hadoop/hadoop-core
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: org.apache.hadoop/hadoop-mapred
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: io.hops/hadoop-mapreduce-client-core
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-core
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);
代码示例来源:origin: io.prestosql.hadoop/hadoop-apache
ReflectionUtils.newInstance(job.getMapRunnerClass(), job);