安装ambari平台
部署机器分布:
master.ambari.com node01.ambari.com node02.ambari.com
[all]三台机器安装完成,配置yum源 --ok
[all]配置域名映射
172.28.128.11 master.ambari.com master 172.28.128.12 node01.ambari.com node01 172.28.128.13 node02.ambari.com node02
[all]每个节点关闭DHCP 设置为静态IP --ok
配置SSH免密码登录 --ok
# master: ssh-keygen cd ~/.ssh/ cat id_rsa.pub >> authorized_keys chmod 600 ~/.ssh chmod 600 ~/.ssh/authorized_keys # node01 mkdir ~/.ssh/ # node02 mkdir ~/.ssh/ # master scp /root/.ssh/authorized_keys root@master:/root/.ssh/authorized_keys scp /root/.ssh/authorized_keys root@node01:/root/.ssh/authorized_keys scp /root/.ssh/authorized_keys root@node02:/root/.ssh/authorized_keys
[master]免密登录测试 --ok
ssh 172.28.128.11 ssh 172.28.128.12 ssh 172.28.128.13
[master]创建ambari系统用户和用户组
adduser ambari passwd ambari
[all]开启NTP服务
yum install ntp -y systemctl is-enabled ntpd systemctl enable ntpd systemctl start ntpd
[all]关闭防火墙
systemctl disable firewalld systemctl stop firewalld
[all]关闭SELinux
# 查看selinux状态 sestatus # 临时关闭,不用重启机器: setenforce 0 # 修改配置文件需要重启机器: vi /etc/sysconfig/selinux SELINUX=disabled
[master]制作本地源
yum install httpd -y firewall-cmd --add-service=http firewall-cmd --permanent --add-service=http systemctl start httpd.service systemctl enable httpd.service yum install yum-utils createrepo -y
下载如下压缩包
Ambari 2.6.0 http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari-2.6.0.0-centos7.tar.gz HDP 2.6.3 http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/HDP-2.6.3.0-centos7-rpm.tar.gz HDP-UTILS 1.1.0.21 http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz
在httpd网站根目录,默认是即/var/www/html/,创建目录ambari,
并且将下载的压缩包解压到/var/www/html/ambari目录
HDP-UTILS需要先建立一个HDP-UTILS文件夹并将HDP-UTILS-1.1.0.21-centos7.tar.gz放到HDP-UTILS目录下再解压
cd /var/www/html/ mkdir ambari cd /var/www/html/ambari/ wget http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari-2.6.0.0-centos7.tar.gz wget http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/HDP-2.6.3.0-centos7-rpm.tar.gz wget http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz tar -zxvf /opt/install/ambari-2.6.0.0-centos7.tar.gz -C ./ tar -zxvf /opt/install/HDP-2.6.3.0-centos7-rpm.tar.gz -C ./ mkdir HDP-UTILS cd HDP-UTILS tar -zxvf /opt/install/HDP-UTILS-1.1.0.21-centos7.tar.gz -C ./
验证httpd网站是否可用,用浏览器直接访问下面的地址,如果能看到目录列表就表示成功:
http://172.28.128.11/ambari/
配置ambari等本地源
cd /etc/yum.repos.d/ vim ambari.repo #VERSION_NUMBER=2.6.0.0-267 [ambari-2.6.0.0] name=ambari Version - ambari-2.6.0.0 baseurl=http://172.28.128.11/ambari/ambari/centos7/2.6.0.0-267 gpgcheck=1 gpgkey=http://172.28.128.11/ambari/ambari/centos7/2.6.0.0-267/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1#VERSION_NUMBER=2.6.3.0-235 [HDP-2.6.3.0] name=HDP Version - HDP-2.6.3.0 baseurl=http://172.28.128.11/ambari/HDP/centos7/2.6.3.0-235 gpgcheck=1 gpgkey=http://172.28.128.11/ambari/HDP/centos7/2.6.3.0-235/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1[HDP-UTILS-1.1.0.21] name=HDP Utils Version - HDP-UTILS-1.1.0.21 baseurl=http://172.28.128.11/ambari/HDP-UTILS gpgcheck=1 gpgkey=http://172.28.128.11/ambari/HDP-UTILS/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins enabled=1 priority=1
执行如下命令
yum clean all yum list update yum makecache yum repolist
[master]安装Mysql数据库
yum install mariadb-server -y systemctl start mariadb systemctl enable mariadb #数据库初始化设置 mysql_secure_installation #首先是设置密码,会提示先输入密码 Enter current password for root (enter for none):<–初次运行直接回车 #设置密码 Set root password? [Y/n] <– 是否设置root用户密码,输入y并回车或直接回车 New password: <– 设置root用户的密码 Re-enter new password: <– 再输入一次你设置的密码 #其他配置 Remove anonymous users? [Y/n] <– 是否删除匿名用户,回车 Disallow root login remotely? [Y/n] <–是否禁止root远程登录,回车, Remove test database and access to it? [Y/n] <– 是否删除test数据库,回车 Reload privilege tables now? [Y/n] <– 是否重新加载权限表,回车 #初始化MariaDB完成,接下来测试登录,输入密码能正常登陆就完成了 mysql -uroot -p
登录数据库执行如下操作(看是否需要hive和oozie)
mysql -uroot -p create database ambari character set utf8 ; CREATE USER 'ambari'@'%'IDENTIFIED BY '123456'; GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'%'; FLUSH PRIVILEGES; create database hive character set utf8 ; CREATE USER 'hive'@'%'IDENTIFIED BY '123456'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'%'; FLUSH PRIVILEGES; create database oozie character set utf8 ; CREATE USER 'oozie'@'%'IDENTIFIED BY '123456'; GRANT ALL PRIVILEGES ON *.* TO 'oozie'@'%'; FLUSH PRIVILEGES;
[master]安装mysql jdbc 驱动
yum install mysql-connector-java -y
[all]安装JDK
# 下载地址:http://www.oracle.com/technetwork/cn/java/javase/downloads/jdk8-downloads-2133151-zhs.html mkdir /opt/java/ cd /opt/install/ tar -zxvf jdk-8u231-linux-x64.tar.gz -C /opt/java/ vim /etc/profile export JAVA_HOME=/opt/java/jdk1.8.0_231 export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar PATH=$PATH:$HOME/bin:$JAVA_HOME/bin source /etc/profile ========================== scp -r java node01:/opt scp -r java node02:/opt scp /etc/profile node01:/etc/ scp /etc/profile node02:/etc/
[master]进行安装Ambari
安装Ambari2.6.0
yum install ambari-server -y
配置Ambari
ambari-server setup 1.检查SELinux是否关闭,如果关闭不用操作Using python /usr/bin/python Setup ambari-server Checking SELinux... SELinux status is 'disabled' 2.提示是否自定义设置。输入:yCustomize user account for ambari-server daemon [y/n] (n)? y 3.ambari-server 账号。输入:ambariEnter user account for ambari-server daemon (root):ambari Adjusting ambari-server permissions and ownership... 4.检查防火墙,如果关闭则不用操作Checking firewall status... Redirecting to /bin/systemctl status iptables.service 5.设置JDK。输入:3Checking JDK... Do you want to change Oracle JDK [y/n] (n)? y [] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8 [] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7 [] Custom JDK ============================================================================== Enter choice (1): 3 6.如果上面选择3自定义JDK,则需要设置JAVA_HOME。输入:/opt/java/jdk1.8.0_231WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts. WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts. Path to JAVA_HOME: /opt/java/jdk1.8.0_152 Validating JDK on Ambari Server...done. Completing setup... 7.数据库配置。选择:yConfiguring database... Enter advanced database configuration [y/n] (n)? y 8.选择数据库类型。输入:3Configuring database... ============================================================================== Choose one of the following options: [1] - PostgreSQL (Embedded) [2] - Oracle [3] - MySQL [4] - PostgreSQL [5] - Microsoft SQL Server (Tech Preview) [6] - SQL Anywhere ============================================================================== Enter choice (3): 3 9.设置数据库的具体配置信息,根据实际情况输入,如果和括号内相同,则可以直接回车。Hostname (localhost): Port (3306): Database name (ambari): Username (ambari): Enter Database Password (Ambari-123): 10.提示必须安装MySQL JDBC,回车结束ambari配置WARNING: Before starting Ambari Server, you must copy the MySQL JDBC driver JAR file to /usr/share/java. Press <enter> to continue.
将Ambari数据库脚本导入到数据库
#用Ambari用户(上面设置的用户)登录mysql mysql -u ambari -p use ambari; source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql; commit;
执行启动命令,启动Ambari服务
ambari-server start
成功启动后在浏览器输入Ambari地址:
http://172.28.128.11:8080/ 出现登录界面,默认管理员账户登录, 账户:admin 密码:admin
如果有条件,可以在此时创建一个快照,防止后面安装服务有问题
安装主机时,如果报如下错误
SSLError:Failed to connect.Please check openssl library versions.
可以做如下操作
# 禁用ssl检查 vim /etc/python/cert-verification.cfg [https] verify=disable # 修改/etc/ambari-agent/conf/ambari-agent.ini,在[security]添加下面内容 force_https_protocol=PROTOCOL_TLSv1_2
重启ambari平台
service ambari-server restart ambari-agent restart
如果安装报错,清理安装包参考如下
yum remove -y hadoop_2* hdp-select* ranger_2* zookeeper* bigtop*atlas-metadata* ambari* spark* slide* strom* hive*
安装mysql需要在对应节点上执行如下命令
rpm --import RPM-GPG-KEY-mysql
最终安装的信息
Admin Name : adminCluster Name : AmbariTotal Hosts : 3 (3 new)Repositories:redhat7 (HDP-2.6): http://172.28.128.13/ambari/HDP/centos7/2.6.3.0-235 redhat7 (HDP-UTILS-1.1.0.21): http://172.28.128.13/ambari/HDP-UTILS Services:HDFS DataNode : 3 hosts NameNode : master.ambari.com NFSGateway : 0 host SNameNode : node01.ambari.com YARN + MapReduce2 App Timeline Server : node01.ambari.com NodeManager : 3 hosts ResourceManager : node01.ambari.com Tez Clients : 3 hosts Hive Metastore : node01.ambari.com HiveServer2 : node01.ambari.com WebHCat Server : node01.ambari.com Database : New MySQL Database HBase Master : master.ambari.com RegionServer : 3 hosts Phoenix Query Server : 0 host Pig Clients : 3 hosts ZooKeeper Server : 3 hosts Ambari Infra Infra Solr Instance : master.ambari.com Ambari Metrics Metrics Collector : node02.ambari.com Grafana : master.ambari.com Kafka Broker : master.ambari.com SmartSense Activity Analyzer : master.ambari.com Activity Explorer : master.ambari.com HST Server : master.ambari.com Spark Livy Server : 0 host History Server : master.ambari.com Thrift Server : 0 host Spark2 Livy for Spark2 Server : 0 host History Server : master.ambari.com Thrift Server : 3 hosts Slider Clients : 3 hosts
安装的时候如果包如下错误,参考解决办法
1、V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY 解决: wget https://repo.mysql.com/RPM-GPG-KEY-mysql
安装ambari平台相关推荐
- 基于【CentOS-7+ Ambari 2.7.0 + HDP 3.0】搭建HAWQ数据仓库01 —— 准备环境,搭建本地仓库,安装ambari...
一.集群软硬件环境准备: 操作系统: centos 7 x86_64.1804 Ambari版本:2.7.0 HDP版本:3.0.0 HAWQ版本:2.3.0 5台PC作为工作站: ep-bd01 ...
- CentOS7.6下安装Ambari
一.准备工作 1.1.准备三台CentOS 1.2.配置静态IP.DNS vi /etc/sysconfig/network-scripts/ficfg-ens33 IPADDR为 配置的ip NET ...
- TinyOS02:TinyOS2.1的安装(Windows平台)
安装TinyOS2.1的详细步骤参照网址:http://tinyos.stanford.edu/tinyos-wiki/index.php/Installing_TinyOS_2.1#Manual_i ...
- 【日志审计与分析】centOS7 安装ELK平台
提示:文章写完后,目录可以自动生成,如何生成可参考右边的帮助文档 文章目录 实验目的 实验环境 一.前情提要 二.服务节点部署 1.环境准备 2.Elasticsearch(实时全文搜索和分析引擎) ...
- u盘软件怎么安装linux,教你怎么使用u盘安装Linux平台
小伙伴你们明白如何使用u盘来安装Linux平台吗?可能大多数的人都好还不太清楚,不知道的也没关系哟,小编这就来将u盘安装Linux平台的操作方法来带来他们. 小伙伴之所以知道借助u盘进行调试Linux ...
- 编译安装baas平台-cello-h3c
编译安装baas平台-cello-h3c ****************************主节点管理员端的操作============= *************************** ...
- (一)Win10安装MindSpore平台
步骤一:进入MindSpore官网,网址如下: MindSpore官网 步骤二:选择MindSpore平台安装的环境(即,按照自己电脑的配置来勾选配置项) 其中:"版本&quo ...
- IIS上安装Web平台安装程序
IIS上安装Web平台安装程序 (1). 如果IIS上默认有安装Web平台安装程序,如下图: 打开后没有web平台安装程序 第一种解决方法 打开控制面板-->程序和功能-->启用和关闭Wi ...
- 编写shell脚本实现自动化搭建安装LNMP平台全过程配置详解
注意:如果是输入的是字母的或者是输入等于0时,则会出现以下两种情况!!! 查看端口: 进到Nginx根目录查看创建好的测试网页: 注意:关闭防火墙或者设置防火墙规则!!! 访问Nginx网页: 访问P ...
最新文章
- 十大最佳Ajax教程(图文)
- activemq - 浅析消息确认模式
- 趣学python3(40)--TCP服务器和客户端(socketserver类)
- 【Python基础】python使用python-docx操作word
- vue 路由按需加载
- 向 mysql导入数据 源码_MySQL 导入数据
- MVC中如何实现本地化的解决方案
- SQLAlchemy的使用---M2M增删改查
- PHP数组数据结构图,PHP数组与数据结构
- 使用nginx反向代理获取百度MP3的真实网址
- 杨辉三角形(Python)
- 衡水十四中2021高考成绩查询,心之所向,行必能至|衡水市第十四中学召开2021高考倒计时200天动...
- 金句: 對比MBA學位,我們更需要PSD學位的人! Poor, Smart and Deep Desire to… | consilient_lollapalooza on Xanga...
- Kafka 消费者模块(三):rebalance的发送JoinGroupResult请求
- Reducer类——hadoop
- python 字符串 1.1 从键盘输入10个英文单词,输出其中以元音字母开头的单词。
- linux limits.conf 生效,limits.conf不生效问题
- ACM Uva10763 交换学生
- 用BWA进行序列比对
- word size计算机,计算机基础结构 - 扣丁书屋 - https://www.codingsky.com