搜索
搜索

如何在Hadoop 2.7.0上编译MapReduce作业源代码？

kliangh 发表于 Dev
19
liang

我在ubuntu 14.0.2操作系统上运行Hadoop 2.7.0，并使用nano文本编辑器创建了wordcount.java，其源代码是从Apache Hadoop 2.7.0 Document复制而来的。

使用此命令编译wordcount.java之后javac -classpath hadoop-2.7.0-core.jar -d MyJava wordcount.java，这是我收到的错误消息。

public class WordCount2 {
       ^
wordcount_v2.java:11: error: package org.apache.hadoop.conf does not exist
import org.apache.hadoop.conf.Configuration;
                             ^
wordcount_v2.java:12: error: package org.apache.hadoop.fs does not exist
import org.apache.hadoop.fs.Path;
                           ^
wordcount_v2.java:13: error: package org.apache.hadoop.io does not exist
import org.apache.hadoop.io.IntWritable;
                           ^
wordcount_v2.java:14: error: package org.apache.hadoop.io does not exist
import org.apache.hadoop.io.Text;
                           ^
wordcount_v2.java:15: error: package org.apache.hadoop.mapreduce does not exist
import org.apache.hadoop.mapreduce.Job;
                                  ^
wordcount_v2.java:16: error: package org.apache.hadoop.mapreduce does not exist
import org.apache.hadoop.mapreduce.Mapper;
                                  ^
wordcount_v2.java:17: error: package org.apache.hadoop.mapreduce does not exist
import org.apache.hadoop.mapreduce.Reducer;
                                  ^
wordcount_v2.java:18: error: package org.apache.hadoop.mapreduce.lib.input does not exist
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
                                            ^
wordcount_v2.java:19: error: package org.apache.hadoop.mapreduce.lib.output does not exist
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
                                             ^
wordcount_v2.java:20: error: package org.apache.hadoop.mapreduce does not exist
import org.apache.hadoop.mapreduce.Counter;
                                  ^
wordcount_v2.java:21: error: package org.apache.hadoop.util does not exist
import org.apache.hadoop.util.GenericOptionsParser;
                             ^
wordcount_v2.java:22: error: package org.apache.hadoop.util does not exist
import org.apache.hadoop.util.StringUtils;
                             ^
wordcount_v2.java:27: error: cannot find symbol
       extends Mapper<Object, Text, Text, IntWritable>{
               ^
  symbol:   class Mapper
  location: class WordCount2
wordcount_v2.java:27: error: cannot find symbol
       extends Mapper<Object, Text, Text, IntWritable>{
                              ^
  symbol:   class Text
  location: class WordCount2
wordcount_v2.java:27: error: cannot find symbol
       extends Mapper<Object, Text, Text, IntWritable>{
                                    ^
  symbol:   class Text
  location: class WordCount2
wordcount_v2.java:27: error: cannot find symbol
       extends Mapper<Object, Text, Text, IntWritable>{
                                          ^
  symbol:   class IntWritable
  location: class WordCount2
wordcount_v2.java:31: error: cannot find symbol
    private final static IntWritable one = new IntWritable(1);
                         ^
  symbol:   class IntWritable
  location: class TokenizerMapper
wordcount_v2.java:32: error: cannot find symbol
    private Text word = new Text();
            ^
  symbol:   class Text
  location: class TokenizerMapper
wordcount_v2.java:37: error: cannot find symbol
    private Configuration conf;
            ^
  symbol:   class Configuration
  location: class TokenizerMapper
wordcount_v2.java:41: error: cannot find symbol
    public void setup(Context context) throws IOException,
                      ^
  symbol:   class Context
  location: class TokenizerMapper
wordcount_v2.java:69: error: cannot find symbol
    public void map(Object key, Text value, Context context
                                ^
  symbol:   class Text
  location: class TokenizerMapper
wordcount_v2.java:69: error: cannot find symbol
    public void map(Object key, Text value, Context context
                                            ^
  symbol:   class Context
  location: class TokenizerMapper
wordcount_v2.java:88: error: cannot find symbol
       extends Reducer<Text,IntWritable,Text,IntWritable> {
               ^
  symbol:   class Reducer
  location: class WordCount2
wordcount_v2.java:88: error: cannot find symbol
       extends Reducer<Text,IntWritable,Text,IntWritable> {
                       ^
  symbol:   class Text
  location: class WordCount2
wordcount_v2.java:88: error: cannot find symbol
       extends Reducer<Text,IntWritable,Text,IntWritable> {
                            ^
  symbol:   class IntWritable
  location: class WordCount2
wordcount_v2.java:88: error: cannot find symbol
       extends Reducer<Text,IntWritable,Text,IntWritable> {
                                        ^
  symbol:   class Text
  location: class WordCount2
wordcount_v2.java:88: error: cannot find symbol
       extends Reducer<Text,IntWritable,Text,IntWritable> {
                                             ^
  symbol:   class IntWritable
  location: class WordCount2
wordcount_v2.java:89: error: cannot find symbol
    private IntWritable result = new IntWritable();
            ^
  symbol:   class IntWritable
  location: class IntSumReducer
wordcount_v2.java:91: error: cannot find symbol
    public void reduce(Text key, Iterable<IntWritable> values,
                       ^
  symbol:   class Text
  location: class IntSumReducer
wordcount_v2.java:91: error: cannot find symbol
    public void reduce(Text key, Iterable<IntWritable> values,
                                          ^
  symbol:   class IntWritable
  location: class IntSumReducer
wordcount_v2.java:92: error: cannot find symbol
                       Context context
                       ^
  symbol:   class Context
  location: class IntSumReducer
wordcount_v2.java:31: error: cannot find symbol
    private final static IntWritable one = new IntWritable(1);
                                               ^
  symbol:   class IntWritable
  location: class TokenizerMapper
wordcount_v2.java:32: error: cannot find symbol
    private Text word = new Text();
                            ^
  symbol:   class Text
  location: class TokenizerMapper
wordcount_v2.java:40: error: method does not override or implement a method from a supertype
    @Override
    ^
wordcount_v2.java:46: error: cannot find symbol
        URI[] patternsURIs = Job.getInstance(conf).getCacheFiles();
                             ^
  symbol:   variable Job
  location: class TokenizerMapper
wordcount_v2.java:48: error: cannot find symbol
          Path patternsPath = new Path(patternsURI.getPath());
          ^
  symbol:   class Path
  location: class TokenizerMapper
wordcount_v2.java:48: error: cannot find symbol
          Path patternsPath = new Path(patternsURI.getPath());
                                  ^
  symbol:   class Path
  location: class TokenizerMapper
wordcount_v2.java:64: error: cannot find symbol
            + StringUtils.stringifyException(ioe));
              ^
  symbol:   variable StringUtils
  location: class TokenizerMapper
wordcount_v2.java:68: error: method does not override or implement a method from a supertype
    @Override
    ^
wordcount_v2.java:80: error: cannot find symbol
        Counter counter = context.getCounter(CountersEnum.class.getName(),
        ^
  symbol:   class Counter
  location: class TokenizerMapper
wordcount_v2.java:89: error: cannot find symbol
    private IntWritable result = new IntWritable();
                                     ^
  symbol:   class IntWritable
  location: class IntSumReducer
wordcount_v2.java:95: error: cannot find symbol
      for (IntWritable val : values) {
           ^
  symbol:   class IntWritable
  location: class IntSumReducer
wordcount_v2.java:104: error: cannot find symbol
    Configuration conf = new Configuration();
    ^
  symbol:   class Configuration
  location: class WordCount2
wordcount_v2.java:104: error: cannot find symbol
    Configuration conf = new Configuration();
                             ^
  symbol:   class Configuration
  location: class WordCount2
wordcount_v2.java:105: error: cannot find symbol
    GenericOptionsParser optionParser = new GenericOptionsParser(conf, args);
    ^
  symbol:   class GenericOptionsParser
  location: class WordCount2
wordcount_v2.java:105: error: cannot find symbol
    GenericOptionsParser optionParser = new GenericOptionsParser(conf, args);
                                            ^
  symbol:   class GenericOptionsParser
  location: class WordCount2
wordcount_v2.java:111: error: cannot find symbol
    Job job = Job.getInstance(conf, "word count");
    ^
  symbol:   class Job
  location: class WordCount2
wordcount_v2.java:111: error: cannot find symbol
    Job job = Job.getInstance(conf, "word count");
              ^
  symbol:   variable Job
  location: class WordCount2
wordcount_v2.java:116: error: cannot find symbol
    job.setOutputKeyClass(Text.class);
                          ^
  symbol:   class Text
  location: class WordCount2
wordcount_v2.java:117: error: cannot find symbol
    job.setOutputValueClass(IntWritable.class);
                            ^
  symbol:   class IntWritable
  location: class WordCount2
wordcount_v2.java:122: error: cannot find symbol
        job.addCacheFile(new Path(remainingArgs[++i]).toUri());
                             ^
  symbol:   class Path
  location: class WordCount2
wordcount_v2.java:128: error: cannot find symbol
    FileInputFormat.addInputPath(job, new Path(otherArgs.get(0)));
                                          ^
  symbol:   class Path
  location: class WordCount2
wordcount_v2.java:128: error: cannot find symbol
    FileInputFormat.addInputPath(job, new Path(otherArgs.get(0)));
    ^
  symbol:   variable FileInputFormat
  location: class WordCount2
wordcount_v2.java:129: error: cannot find symbol
    FileOutputFormat.setOutputPath(job, new Path(otherArgs.get(1)));
                                            ^
  symbol:   class Path
  location: class WordCount2
wordcount_v2.java:129: error: cannot find symbol
    FileOutputFormat.setOutputPath(job, new Path(otherArgs.get(1)));
    ^
  symbol:   variable FileOutputFormat
  location: class WordCount2
56 errors

我想知道怎么回事。我的JDK版本是1.8.0_45

文卡特

使用Maven进行依赖性管理。您要在此处进行的操作是在HelloWorld级别上进行的。

请参考以下链接为Hadoop项目设置Maven：适用于Hadoop的Maven

本文收集自互联网，转载请注明来源。

如有侵权，请联系 [email protected] 删除。

编辑于
0

我来说两句

0 条评论
登录 后参与评论

相关文章

如何更改 Grails 2 的 Tomcat 7 插件源代码

如何在Windows 7 32位的Ubuntu 14.04 64位VM上安装Big Data Hadoop

如何在Windows 7 32位的Ubuntu 14.04 64位VM上安装Big Data Hadoop

如何在Windows 7上安装Psycopg2

如何在CentOS v7上从源代码安装NTP？（/ bin / ld：找不到-lcap）

如何从github上的源代码进行编译？

如何使apache2使用从源代码编译的PHP 5.4.5？

如何使用Evince3源代码中的msys2在Windows上编译Evince3？

如何在 Win 10 上从源代码编译 opencv

如何在17.10上从源代码编译Geany

如何在OpenShift上编译和安装源代码？

如何在Eclipse中导入Java-7源代码

从源代码在CentOS 7上构建Ambari 2.7.5，工作于2周前，现在失败了

如何在Hadoop作业中保持状态？

如何在IIS7 Windows Server 2008 R2上启用TLS1.2

如何在 CentOS7 中的 Virtualmin 上启用/安装 HTTP/2

Amazon EC2如何在Centos 7实例上安装ixgbevf？

如何在Centos 7上使用gnutls编译emacs 26.2？

如何在Hadoop上配置弹性搜索？

如何在Linux上从C源代码生成nasm可编译汇编代码？

如何从 debian 10 上的源代码重新编译 dpkg？

如何在TFS中保留2个版本的源代码

如何在CentOS 7 / RHEL 7上安装Sublime 3？

在Windows 7上如何/在哪里安装Console2

如何在centos 7上使用iptables？

如何在Win 7上安装gtk

如何在centos 7上停止posgresql？

如何在Windows 7上安装GCC

如何在Windows 7上安装Angular

TOP 榜单

  1. 1

    Linux的官方Adobe Flash存储库是否已过时？

  2. 2

    在 Python 2.7 中。如何从文件中读取特定文本并分配给变量

  3. 3

    如何检查字符串输入的格式

  4. 4

    如何使用HttpClient的在使用SSL证书，无论多么“糟糕”是

  5. 5

    Modbus Python施耐德PM5300

  6. 6

    错误TS2365：运算符'！=='无法应用于类型'“（”'和'“）”'

  7. 7

    用日期数据透视表和日期顺序查询

  8. 8

    检查嵌套列表中的长度是否相同

  9. 9

    Java Eclipse中的错误13，如何解决？

  10. 10

    ValueError：尝试同时迭代两个列表时，解包的值太多（预期为 2）

  11. 11

    如何监视应用程序而不是单个进程的CPU使用率？

  12. 12

    如何自动选择正确的键盘布局？-仅具有一个键盘布局

  13. 13

    ES5的代理替代

  14. 14

    在令牌内联程序集错误之前预期为 ')'

  15. 15

    有什么解决方案可以将android设备用作Cast Receiver？

  16. 16

    套接字无法检测到断开连接

  17. 17

    如何在JavaScript中获取数组的第n个元素？

  18. 18

    如何将sklearn.naive_bayes与（多个）分类功能一起使用？

  19. 19

    应用发明者仅从列表中选择一个随机项一次

  20. 20

    在Windows 7中无法删除文件（2）

  21. 21

    ggplot：对齐多个分面图-所有大小不同的分面

热门标签

归档