Hadoop基础教程-第13章 源码编译(13.4 Hive2.1.1源码编译)

第13章 源码编译

13.4 Hive2.1.1源码编译

13.4.1 下载源码

https://mirrors.tuna.tsinghua.edu.cn/apache/hive/

单击stable-2

下载源码apache-hive-2.1.1-src.tar.gz

13.4.2 环境准备

Hive2.1.1的源码包需要JDK1.8。如果使用JDK1.7编译是总是产生各种奇怪的问题,GC overhead limit exceeded

使用Ali镜像时出现问题

The POM for org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde is missing, no dependency information available

于是,不启用Ali镜像

[root@cyq apache-hive-2.1.1-src]# vi /opt/apache-maven-3.3.9/conf/settings.xml
  <mirrors>
    <!-- mirror
     | Specifies a repository mirror site to use instead of a given repository. The repository that
     | this mirror serves has an ID that matches the mirrorOf element of this mirror. IDs are used
     | for inheritance and direct lookup purposes, and must be unique across the set of mirrors.
     |
    <mirror>
      <id>mirrorId</id>
      <mirrorOf>repositoryId</mirrorOf>
      <name>Human Readable Name for this Mirror.</name>
      <url>http://my.repository.com/repo/path</url>
    </mirror>
     -->
       <!--
    <mirror>
        <id>nexus-aliyun</id>
        <mirrorOf>*</mirrorOf>
        <name>Nexus aliyun</name>
        <url>http://maven.aliyun.com/nexus/content/groups/public</url>
    </mirror>
       -->
  </mirrors>

13.4.3 开始编译

[root@cyq apache-hive-2.1.1-src]# export MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1024m"
[root@cyq apache-hive-2.1.1-src]# mvn clean package -Phadoop-2 -Pdist -DskipTests -Dtar

[INFO] Reactor Summary:
[INFO] 
[INFO] Hive ............................................... SUCCESS [  0.877 s]
[INFO] Hive Shims Common .................................. SUCCESS [  1.735 s]
[INFO] Hive Shims 0.23 .................................... SUCCESS [  1.321 s]
[INFO] Hive Shims Scheduler ............................... SUCCESS [  0.509 s]
[INFO] Hive Shims ......................................... SUCCESS [  0.415 s]
[INFO] Hive Storage API ................................... SUCCESS [  0.536 s]
[INFO] Hive ORC ........................................... SUCCESS [  1.636 s]
[INFO] Hive Common ........................................ SUCCESS [  2.218 s]
[INFO] Hive Service RPC ................................... SUCCESS [  1.044 s]
[INFO] Hive Serde ......................................... SUCCESS [  1.632 s]
[INFO] Hive Metastore ..................................... SUCCESS [  7.775 s]
[INFO] Hive Ant Utilities ................................. SUCCESS [  0.131 s]
[INFO] Hive Llap Common ................................... SUCCESS [  1.101 s]
[INFO] Hive Llap Client ................................... SUCCESS [  0.708 s]
[INFO] Hive Llap Tez ...................................... SUCCESS [  0.886 s]
[INFO] Spark Remote Client ................................ SUCCESS [  1.677 s]
[INFO] Hive Query Language ................................ SUCCESS [ 36.962 s]
[INFO] Hive Llap Server ................................... SUCCESS [ 38.075 s]
[INFO] Hive Service ....................................... SUCCESS [01:26 min]
[INFO] Hive Accumulo Handler .............................. SUCCESS [ 31.816 s]
[INFO] Hive JDBC .......................................... SUCCESS [01:37 min]
[INFO] Hive Beeline ....................................... SUCCESS [ 15.614 s]
[INFO] Hive CLI ........................................... SUCCESS [  0.772 s]
[INFO] Hive Contrib ....................................... SUCCESS [  0.536 s]
[INFO] Hive HBase Handler ................................. SUCCESS [ 20.985 s]
[INFO] Hive HCatalog ...................................... SUCCESS [ 48.139 s]
[INFO] Hive HCatalog Core ................................. SUCCESS [  5.561 s]
[INFO] Hive HCatalog Pig Adapter .......................... SUCCESS [  4.961 s]
[INFO] Hive HCatalog Server Extensions .................... SUCCESS [ 25.777 s]
[INFO] Hive HCatalog Webhcat Java Client .................. SUCCESS [  0.893 s]
[INFO] Hive HCatalog Webhcat .............................. SUCCESS [ 29.462 s]
[INFO] Hive HCatalog Streaming ............................ SUCCESS [  0.941 s]
[INFO] Hive HPL/SQL ....................................... SUCCESS [ 24.698 s]
[INFO] Hive HWI ........................................... SUCCESS [  0.588 s]
[INFO] Hive Llap External Client .......................... SUCCESS [  0.576 s]
[INFO] Hive Shims Aggregator .............................. SUCCESS [  0.022 s]
[INFO] Hive TestUtils ..................................... SUCCESS [  0.041 s]
[INFO] Hive Packaging ..................................... SUCCESS [ 42.897 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:57 min
[INFO] Finished at: 2017-07-28T14:56:43+08:00
[INFO] Final Memory: 271M/1300M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop-2" could not be activated because it does not exist.
您在 /var/spool/mail/root 中有新邮件
[root@cyq apache-hive-2.1.1-src]# 

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

发表于

我来说两句

0 条评论
登录 后参与评论

相关文章

来自专栏北京马哥教育

OpenStack Icehouse私有云实战部署(一)

前言 相信你一定对“云主机”一词并不陌生吧,通过在Web页面选择所需主机配置,即可快速定制一台属于自己的虚拟主机,并实现登陆操作,大大节省了物理资源。但这一过程...

3199
来自专栏数据和云

ORACLE数据库的连接

作者介绍:姜刚,云和恩墨技术顾问,2016年开始专职从事DBA运维,ORACLE OCP,精通shell及perl编程。 本文由恩墨大讲堂143期线上分享整理而...

5046
来自专栏大魏分享(微信公众号:david-share)

IBM PowerHA 6 DARE 的功能介绍

DARE 的功能介绍 PowerHA 6.1 提供了 cluster 动态调整的功能,即在 cluster 处于活动的状态时,动态地对 cluster 拓扑和资...

34412
来自专栏Rainbond开源「容器云平台」

理解Docker跨多主机容器网络

1665

使用ACS和Kubernetes部署Red Hat JBoss Fuse

红帽JBoss Fuse 十多年来一直是构建Java Web / RESTful服务的实际标准。但是,如何在当今以云为中心的世界中该怎样高效运行?如您所见,基础...

1716
来自专栏Rainbond开源「容器云平台」

Docker 网络构造:Docker如何使用Linux iptables和Interfaces

1062
来自专栏散尽浮华

Tomcat集群环境下session共享方案梳理(1)-通过memcached(MSM)方法实现

对于web应用集群的技术实现而言,最大的难点就是:如何能在集群中的多个节点之间保持数据的一致性,会话(Session)信息是这些数据中最重要的一块。要实现这一点...

5469
来自专栏Hadoop实操

如何使用Cloudera Manager启用HDFS的HA

在HDFS集群中NameNode存在单点故障(SPOF),对于只有一个NameNode的集群,如果NameNode机器出现意外,将导致整个集群无法使用。为了解决...

7424
来自专栏Hadoop实操

如何通过Cloudera Manager配置Spark1和Spark2的运行环境

大部分用户在使用CDH集群做Spark开发的时候,由于开发环境的JDK版本比CDH集群默认使用的JDK1.7.0_67-cloudera版本新,可能会出现Spa...

5297
来自专栏Hadoop实操

如何在Kerberos的Linux上安装及配置Impala的ODBC驱动

Impala提供了多种访问方式如impala-shell、beeline、JDBC以及ODBC等方式,关于beeline、JDBC的连接方式可以参考Fayson...

3755

扫码关注云+社区