【原创】大数据基础之Ambari（5）通过Ambari部署Hue

ambari2.7.3（hdp3.1） 安装 hue4.2

ambari的hdp中原生不支持hue安装，下面介绍如何通过添加service的方式使ambari支持hue安装：

官方：http://gethue.com/

Hue is an open source Workbench for developing and accessing Data Apps.

一 安装SERVICE

第三方service：https://github.com/EsharEditor/ambari-hue-service

1 下载

VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'`
rm -rf /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE
sudo git clone https://github.com/EsharEditor/ambari-hue-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE

2 修改

第三方service中安装的是hue3.11，改为4.2，需要如下改动：

# cd /var/lib/ambari-server/resources/stacks/HDP/3.1/services/HUE
# sed -i 's/3.11.0/4.2.0/g' metainfo.xml
# sed -i 's/3.11.0/4.2.0/g' README.md
# sed -i 's/3.11.0/4.2.0/g' package/scripts/params.py
# sed -i 's/3.11.0/4.2.0/g' package/scripts/setup_hue.py

 

# vi package/scripts/params.py

--modify line

32 #download_url = 'cat /etc/yum.repos.d/HDP.repo | grep "baseurl" | awk -F \'=\' \'{print $2"hue/hue-4.2.0.tgz"}\''
33 download_url = 'echo "http://gethue.com/downloads/releases/4.2.0/hue-4.2.0.tgz"'

187 webhdfs_url = format('http://' + hdfs_httpfs_host + ':50070/webhdfs/v1')

--without yarn

:234,256s/^/#/g

 

# vi package/scripts/common.py

--add line 59,63,64

58 Execute('tar -zxvf hue.tgz -C {0} && rm -f hue.tgz'.format(params.hue_install_ dir))
59 Execute('mkdir -p {0}'.format(params.hue_dir))
60 # Ensure all Hue files owned by hue 61 Execute('chown -R {0}:{1} {2}'.format(params.hue_user,params.hue_group,params. hue_dir))
62 Execute('ln -s {0} /usr/hdp/current/hue-server'.format(params.hue_dir))
63 Execute('rm -rf {0}/*'.format(params.hue_dir))
64 Execute('cd /usr/local/hue-4.2.0 && make install')

--comment line

90 #services_configurations['httpfs-site'] = {}
91 #services_configurations['httpfs-site']['httpfs.proxyuser.hue.groups'] = '*'
92 #services_configurations['httpfs-site']['httpfs.proxyuser.hue.hosts'] = '*'

 

# vi package/scripts/setup_hue.py

--comment line

26 #Logger.info("Creating symlinks /usr/hdp/current/hadoop-client/lib/hue-plugins -4.2.0-SNAPSHOT.jar")
27 #Link("{0}/desktop/libs/hadoop/java-lib/*".format(params.hue_dir),to = "/usr/h dp/current/hadoop-client/lib")

 

# vi package/files/configs.sh

39 PASSWD="admin"

注意这一步

download_url = 'echo "http://gethue.com/downloads/releases/4.2.0/hue-4.2.0.tgz"'

hue-4.2.0.tgz需要手工下载并放到一个服务器可访问的url上（比如本地的nginx），同时修改这里的download_url

二 在ambari中部署

1 添加用户

useradd hue

2 页面部署安装hue

安装后的hue目录位于/usr/local/hue/

3 修改配置

1）修改数据库配置

# vi desktop/conf/hue.ini

  [[database]]

    # Database engine is typically one of:

    # postgresql_psycopg2, mysql, sqlite3 or oracle.

    #

    # Note that for sqlite3, 'name', below is a path to the filename. For other backends, it is the database name

    # Note for Oracle, optiOns={"threaded":true} must be set in order to avoid crashes.

    # Note for Oracle, you can use the Oracle Service Name by setting "host=" and "port=" and then "name=:/".

    # Note for MariaDB use the 'mysql' engine.

    ## engine=sqlite3

    ## host=

    ## port=

    ## user=

    ## password=

    # conn_max_age option to make database connection persistent value in seconds

    # https://docs.djangoproject.com/en/1.9/ref/databases/#persistent-connections

    ## conn_max_age=0

    # Execute this script to produce the database password. This will be used when 'password' is not set.

    ## password_script=/path/script

    ## name=desktop/desktop.db

修改engine、host、port、user、password、name

2）初始化数据库

# build/env/bin/hue syncdb

其中会创建初试用户名和密码

# build/env/bin/hue migrate

3）如果要支持数据库查询比如mysql，找到

  [[databases]]

 

    # mysql, oracle, or postgresql configuration.

    ## [[[mysql]]]

      # Name to show in the UI.

      ## nice_name="My SQL DB"

 

      # For MySQL and PostgreSQL, name is the name of the database.

      # For Oracle, Name is instance of the Oracle server. For express edition

      # this is 'xe' by default.

      ## name=mysqldb

 

      # Database backend to use. This can be:

      # 1. mysql

      # 2. postgresql

      # 3. oracle

      ## engine=mysql

 

      # IP or hostname of the database to connect to.

      ## host=localhost

 

      # Port the database server is listening to. Defaults are:

      # 1. MySQL: 3306

      # 2. PostgreSQL: 5432

      # 3. Oracle Express Edition: 1521

      ## port=3306

 

      # Username to authenticate with when connecting to the database.

      ## user=example

 

      # Password matching the username to authenticate with when

      # connecting to the database.

      ## password=example

按照注释添加即可，可添加多个

4）如果需要增加impala查询，找到

[impala]

  # Host of the Impala Server (one of the Impalad)

  # server_host=localhost

 

  # Port of the Impala Server

  ## server_port=21050

注意这里是21050端口，不是impala-shell连接的21000端口

5）可以通过配置blacklist来隐藏一些组件的菜单

[desktop]

 app_blacklist=beeswax,impala,security,filebrowser,jobbrowser,rdbms,jobsub,pig,hbase,sqoop,zookeeper,metastore,spark,oozie,indexer

4 启动

直接启动

# build/env/bin/hue runcherrypyserver

后台启动supervisor（supervisor会监控并启动hue server）

# nohup build/env/bin/supervisor start >> logs/hue.out 2>&1 &

日志位于 /usr/local/hue/logs/ 下

三 使用

 

如果hue使用nginx代理，一定要设置Host，否则会报400错误：

location / {

  proxy_pass http://hue_backend;

  proxy_set_header Host hue.anything;

}

另外还可以使用nginx来管理hue的静态文件，加速访问； 

 

参考：https://blog.csdn.net/zhouyuanlinli/article/details/83374416