华为fusionInsight集群客户端安装

1.集群下载客户端

从FusionInsight Manager上下载Fusioninsight的客户端，服务管理->下载客户端->完整客户端，上传服务器解压

注意：客户端生成及下载时间都比较长

2.创建安装目录
$： sudo mkdir /opt/third

3.安装

3.1.解压安装包
$ tar -xvf FusionInsight_Services_Client.tar

3.2.进入安装包执行：

$: ./install.sh /opt/third/client

4.设置环境变量

$ : source /opt/third/client/bigdata_env

5.验证

5.1.执行：
$ spark-submit

结果：

```shell
Usage: spark-submit [options] <app jar | python file | R file> [app arguments]
Usage: spark-submit --kill [submission ID] --master [spark://...]
Usage: spark-submit --status [submission ID] --master [spark://...]
Usage: spark-submit run-example [options] example-class [example args]

Options:
--master MASTER_URL spark://host:port, mesos://host:port, yarn,
k8s://https://host:port, or local (Default: local[*]).
--deploy-mode DEPLOY_MODE Whether to launch the driver program locally ("client") or
on one of the worker machines inside the cluster ("cluster")
(Default: client).
--class CLASS_NAME Your application's main class (for Java / Scala apps).
--name NAME A name of your application.
--jars JARS Comma-separated list of jars to include on the driver
and executor classpaths.
--packages Comma-separated list of maven coordinates of jars to include
on the driver and executor classpaths. Will search the local
maven repo, then maven central and any additional remote
repositories given by --repositories. The format for the
coordinates should be groupId:artifactId:version.
--exclude-packages Comma-separated list of groupId:artifactId, to exclude while
resolving the dependencies provided in --packages to avoid
dependency conflicts.
--repositories Comma-separated list of additional remote repositories to
search for the maven coordinates given with --packages.
--py-files PY_FILES Comma-separated list of .zip, .egg, or .py files to place
on the PYTHONPATH for Python apps.
--files FILES Comma-separated list of files to be placed in the working
directory of each executor. File paths of these files
in executors can be accessed via SparkFiles.get(fileName).

--conf PROP=VALUE Arbitrary Spark configuration property.
--properties-file FILE Path to a file from which to load extra properties. If not
specified, this will look for conf/spark-defaults.conf.
```

5.2.如果集群开启了kerberos认证，则需要集群下载对应的keytab文件到服务器

执行：

$: kinit -kt yours_keytabs yoursprincpal

类似kinit -kt /opt/admin.keytab admin

$:klist 检查

验证 (出现结果即成功)

$:hdfs dfs -ls /user

6.常见错误解决

6.1.执行命令sudo ./install.sh /opt/third/client的时候遇到:
[19-07-15 16:06:58]: Pre-install check begin...
[19-07-15 16:06:58]: Checking necessary files and directory.
[19-07-15 16:06:58]: Checking NTP service status.
[19-07-15 16:06:58]: Error: Network time protocol(NTP) not running. Please start NTP first.

解决：启动ntp即可
$:sudo systemctl start ntpd

华为fusionInsight集群客户端安装相关推荐

FusionInsight 华为hadoop集群客户端安装与使用
1.客户端的安装 1.1.下载客户端,如下图所示 1.2.解压客户端,并且开启NTP服务首先检查 service ntpd status,如果关闭需要开启 service ntpd start 1 ...
Hadoop教程(二)Hadoop伪集群环境安装
Hadoop教程(二)Hadoop伪集群环境安装本文链接:https://blog.csdn.net/yuan_xw/article/details/50039325 Hadoop教程(二)Hado ...
Hadoop伪分布式集群的安装部署
Hadoop伪分布式集群的安装部署Hadoop伪分布式集群的安装部署首先可以为Linux虚拟机搭建起来的最初状态做一个快照,方便后期搭建分布式集群时多台Linux虚拟机的准备. 一.如何为虚拟机做快 ...
Redis集群如何安装
Redis集群如何安装集群安装步骤安装gcc 解压redis 包 make make install 目录解析创建redis-cluster 修改节点配置 star-all脚本 shutdow ...
Linux Redis集群搭建与集群客户端实现
硬件环境本文适用的硬件环境如下 Linux版本:CentOS release 6.7 (Final) Redis版本:3.2.1 Redis已经成功安装,安装路径为/home/idata/yangf ...
Hadoop分布式集群的安装与部署实训总结报告
目录前言一.Hadoop平台框介绍 1.Hadoop的架构 2.HDFS:遵循主从架构,它具有以下元素. 2.1 名称节点 -Namenode 2.2 数据节点 - Datanode 2.3 块 ...
kafka集群kafka-eagle安装
目录 kafka安装解压安装包修改配置文件启动集群 kafka-eagle安装解压安装包修改配置文件程序启动与停止访问页面问题解决 kafka安装前提条件:kafka依赖zookee ...
CentOS集群上安装Ganglia-3.6.1监控
CentOS集群上安装Ganglia-3.6.1监控 1.安装依赖 1.建议使用超级用户安装 yum -y install apr-devel apr-util check-devel cairo-d ...
Haoop之hbase高可用集群的安装与使用
Haoop之hbase高可用集群的安装与使用实验目的.要求掌握完全分布模式的整合平台中HBase的高可用完全分布模式的安装 1.完成HBase的高可用完全分布模式的安装 2.HBase的相关服务 ...

华为fusionInsight集群客户端安装

华为fusionInsight集群客户端安装相关推荐

最新文章

热门文章