Hive是一个数据仓库基础工具在Hadoop中用来处理结构化数据。它架构在Hadoop之上&＃xff0c;总归为大数据&＃xff0c;并使得查询和分析方便。并提供简单的sql查询功能&＃xff0c;可以将sql语句转换为MapReduce任务进行运行。
环境介绍&＃xff1a;
hadoop&＃xff1a;3.2.0
jdk&＃xff1a;1.8
Linux&＃xff1a;centos7
mysql&＃xff1a;5.6
1.mysql安装配置
wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm
rpm -ivh mysql-community-release-el7-5.noarch.rpm
执行yum install -y mysql -server
Systemctl start mysql
完成
2.配置创建hive需要的数据库以及账户
create database hive;
create user &＃39;hadoop1&＃39;&＃64;&＃39;localhost&＃39; identified by &＃39;12345678&＃39;;grant all privileges on *.* to &＃39;hadoop1&＃39;&＃64;&＃39;localhost&＃39; with grant option;
3.下载hive
wget http://mirror.bit.edu.cn/apache/hive/hive-3.1.1/apache-hive-3.1.1-bin.tar.gz
tar xzvf apache-hive-3.1.1-bin.tar.gz
cd hive-3.1.1
4.配置hive以及hadoop的变量记得source 让bianl生效。
vim /etc/profile
export HIVE_HOME&＃61;/home/apache-hive-3.1.1-bin
export HADDOP_HOME&＃61;/home//home/hadoop-3.2.0
export PATH&＃61;.:${JAVA_HOME}/bin/:$HIVE_HOME/bin:$HADOOP_HOME/bin:$PATH
5.编辑hive-site.xml 和hive-env.sh文件
此文件是通过hive-default.xml.template 复制出来的&＃xff0c;需要删除原文件所有内容后新增如下配置&＃xff0c;因为hive在启动的时候会加载两个文件&＃xff0c;default.xml和Hive-site.xml&＃xff0c;所以如果直接新增一下内容是无效的。[root&＃64;localhost conf]# cat hive-site.xml
hive-env.sh
6.在初始化前查看是否有mysql的connectorjar包如果没有请下载
[root&＃64;localhost apache-hive-3.1.1-bin]# ll lib/mysql-
mysql-connector-java-5.1.47.jar
下载地址&＃xff1a;http://central.maven.org/maven2/mysql/mysql-connector-java/找对应的下载即可。
wget http://central.maven.org/maven2/mysql/mysql-connector-java/5.1.47/mysql-connector-java-5.1.47.jar
7.初始化hive
[root&＃64;localhost apache-hive-3.1.1-bin]# bin/schematool -dbType mysql -initSchema
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/apache-hive-3.1.1-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist&＃61;true
Metastore Connection Driver : com.mysql.jdbc.Driver
Metastore connection User: hadoop
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.mysql.sql
······································此处省略 太多log了----------
Initialization script completed
schemaTool completed
8.出现初始化完成之后可以去mysql数据库中查看hive下的表
会出现74张表。到此hive的配置和部署完成。
京公网安备 11010802041100号