【Hadoop遇到的坑】运行hadoop自带的例子报错 Error: Could not find or load main class org.apache.hadoop.mapred.YarnCh
原创不易,未经允许,请勿转载。
博客主页:https://xiaojujiang.blog.csdn.net/
2021-05-09 22:31:33,652 INFO client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.10.103:8032
2021-05-09 22:31:34,985 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/atguigu/.staging/job_16205706
2021-05-09 22:31:35,147 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-05-09 22:31:36,157 INFO input.FileInputFormat: Total input files to process : 1
2021-05-09 22:31:36,236 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-05-09 22:31:36,380 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-05-09 22:31:36,430 INFO mapreduce.JobSubmitter: number of splits:1
2021-05-09 22:31:36,801 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2021-05-09 22:31:36,915 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1620570661027_0001
2021-05-09 22:31:36,915 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-05-09 22:31:37,558 INFO conf.Configuration: resource-types.xml not found
2021-05-09 22:31:37,559 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-05-09 22:31:37,928 INFO impl.YarnClientImpl: Submitted application application_1620570661027_0001
2021-05-09 22:31:38,478 INFO mapreduce.Job: The url to track the job: http://hadoop103:8088/proxy/application_1620570661027_0001/
2021-05-09 22:31:38,479 INFO mapreduce.Job: Running job: job_1620570661027_0001
2021-05-09 22:31:46,632 INFO mapreduce.Job: Job job_1620570661027_0001 running in uber mode : false
2021-05-09 22:31:46,633 INFO mapreduce.Job: map 0% reduce 0%
2021-05-09 22:31:50,715 INFO mapreduce.Job: Task Id : attempt_1620570661027_0001_m_000000_0, Status : FAILED
[2021-05-09 22:31:49.268]Exception from container-launch.
Container id: container_1620570661027_0001_01_000002
Exit code: 1[2021-05-09 22:31:49.297]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapred.YarnChild[2021-05-09 22:31:49.298]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapred.YarnChild2021-05-09 22:31:53,796 INFO mapreduce.Job: Task Id : attempt_1620570661027_0001_m_000000_1, Status : FAILED
[2021-05-09 22:31:52.393]Exception from container-launch.
Container id: container_1620570661027_0001_01_000003
Exit code: 1[2021-05-09 22:31:52.398]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapred.YarnChild[2021-05-09 22:31:52.399]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapred.YarnChild
首先先执行下面这个命令,获取所有的类路径。
hadoop classpath
然后在etc/hadoop/mapred-site.xml
中加入下面这个标签。其中<value>
里面的值就是上面hadoop classpath
运行后的输出内容
<property>
<name>mapreduce.application.classpath</name>
<value>/opt/module/hadoop-3.1.3/etc/hadoop:/opt/module/hadoop-3.1.3/share/hadoop/common/lib/*:/opt/module/hadoop-3.1.3/share/hadoop/common/*:/opt/module/hadoop-3.1.3/share/hadoop/hdfs:/opt/module/hadoop-3.1.3/share/hadoop/hdfs/lib/*:/opt/module/hadoop-3.1.3/share/hadoop/hdfs/*:/opt/module/hadoop-3.1.3/share/hadoop/mapreduce/lib/*:/opt/module/hadoop-3.1.3/share/hadoop/mapreduce/*:/opt/module/hadoop-3.1.3/share/hadoop/yarn:/opt/module/hadoop-3.1.3/share/hadoop/yarn/lib/*:/opt/module/hadoop-3.1.3/share/hadoop/yarn/*</value>
</property>
拒绝白嫖从一键三连开始!
原创不易,未经允许,请勿转载。
博客主页:https://xiaojujiang.blog.csdn.net/
【Hadoop遇到的坑】运行hadoop自带的例子报错 Error: Could not find or load main class org.apache.hadoop.mapred.YarnCh相关推荐
- 执行work count程序报错Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
程序执行过程报错:Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster 根据报错提示 找到h ...
- 记录hadoop3.2.2出现Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster问题
问题: hadoop3.2.2运行集群自带wordcount功能时出现以下错误: [xiaobai@hadoop102 hadoop]$ hadoop jar share/hadoop/mapredu ...
- Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
我发现大部分网络遇到这个问题的时候,是应为org.apache.hadoop.mapreduce.v2.app.MRAppMaster 类没有在启动的时候被加载到,或者说在使用的时候. 不知道有没有人 ...
- 在hive3.1.2中插入数据,报could not find or load main class org.apache.hadoop.mapred.YarnChild
在hive3.1.2中插入数据,报could not find or load main class org.apache.hadoop.mapred.YarnChild 报错如下 原因是内存不足,因 ...
- 命令行使用java运行程序报错:Could not find or load main class
在初学java的时候希望新建一个类并且在命令行中运行它,偶尔会遇到上述报错,具体过程如下: d:/demo.java: public class Demo{public static void mai ...
- 运行Linux脚本时候出现Error: Could not find or load main class和No such file or directory错误信息
在运行Linux脚本文件时,出现了Error: Could not find or load main class和No such file or directory 错误,但是我可以确认jar包中是 ...
- WRF运行过程中遇到的各种报错记录
做了hpc技术支持,免不了运行wrf模式.开个帖子记录自己运行模式的时候遇到的各种报错. 2022.5.27 多云 低级错误 运行ungrid.exe遇到了以下报错 Subroutine DATINT ...
- Hadoop启动NameNode报错ERROR Cannot set priority of namenode process 2639
项目场景: Hadoop启动NameNode报错::ERROR: Cannot set priority of namenode process 问题描述: Hadoop启动NameNode报错ERR ...
- laravel项目运行 php artisan cache:clear 命令报错
laravel项目运行 php artisan cache:clear 命令报错 vscode 项目运行 php artisan cache:clear 命令 出现报错 Failed to clear ...
最新文章
- 用Mysql创建设备管理信息系统数据库(图解)
- zoj3882 博弈
- python3精要(18)-函数主要概念
- swift - 使用系统app导航
- 用matlab处理grib2,关于Matlab2017b读取GRIB2文件的问题
- SQLite多线程写锁文件解决方案
- ubuntu 更改文件夹拥有者和权限
- 4. 实例palybook安装管理flume
- ubuntu 系统获取和阅读 linux 源码
- 【状压DP】易懂讲解状态压缩/状态压缩DP
- terser作为js代码压缩工具
- Dying In The Sun~~逝去于阳光之下
- 杠杆炒股亏损多少就会被平仓?
- 7年加工作经验的程序员,从大厂跳槽出来,遭遇了什么?
- MATLAB中代尔塔的符号,这个符号代表什么意思?还有怎么打?~
- 分享一个vue头像组件 vue-avatar
- 快速计算CRC校验(异或)的方法
- Win7系统只要一打开浏览器就死机 win7打开网页浏览器卡死怎么办
- html制作满天星,满天星怎么养?细心呵护也能做成干花!
- 论OpenVZ与KVM的区别
热门文章
- 在Python中编写动态SQL语句
- 考研党的8大错觉,是不是你?
- 【青训营】Go的一些性能优化技巧
- RPC是什么?RPC与REST、Socket的区别?php中流行的rpc框架有哪些?
- HTML5+CSS——Day1
- 拓嘉启远:遇到恶劣的拼多多买家怎么办
- 计算机公式YEAR的含义是,Excel 中函数YEAR是什么意思,year是什么意思怎么读通俗点...
- ceph存储三种类型
- 视频教程-C语言编程入门/C二级神器/游戏破解-C/C++
- css实现多行换行,并自动在后面加省略号