CentOs安装pyhive

yum install gcc-c++ python-devel.x86_64 cyrus-sasl-devel.x86_64

pip install sasl
pip install thrift
pip install thrift-sasl

pip install PyHive

以下为代码demo，功能是打印出所有表的建表语句。代码中连接的hive使用的LDAP验证方式，所以设置了用户名和密码。

import os
import sys
reload(sys)
sys.setdefaultencoding(&＃39;utf8&＃39;)
from pyhive import hiveusername = your user name
password = your pwd#database = &＃39;test&＃39;
#dir_name = &＃39;/home/lwx/data/&＃39;+&＃39;dw&＃39;+&＃39;.sql&＃39;cnn=hive.Connection(host=&＃39;your ip add&＃39;, port=&＃39;10000&＃39;,auth=&＃39;LDAP&＃39;,username = username,password = password )
cursor=cnn.cursor()
dbs = [&＃39;test1&＃39;,&＃39;test2&＃39;,&＃39;test3&＃39;]for db in dbs:cursor.execute("show tables in %s"%(db))for table in cursor.fetchall():cursor.execute("show create table %s.%s"%(db,table[0]))for i in cursor.fetchall():print str(i[0])

如果没有设置验证方式，如下

import os
import sys
reload(sys)
sys.setdefaultencoding(&＃39;utf8&＃39;)
from pyhive import hivecnn=hive.Connection(host=&＃39;your ip add&＃39;, port=&＃39;10000&＃39;,username = username ) #connection中也可以指定db
cursor=cnn.cursor()
dbs = [&＃39;test1&＃39;,&＃39;test2&＃39;,&＃39;test3&＃39;]for db in dbs:cursor.execute("show tables in %s"%(db))for table in cursor.fetchall():cursor.execute("show create table %s.%s"%(db,table[0]))for i in cursor.fetchall():print str(i[0]) # print or other operations~

add ： 2019-10-22

安装sasl遇到错误 ：  error: sasl/sasl.h: No such file or directory

解决： yum -y install cyrus-sasl cyrus-sasl-devel cyrus-sasl-lib