Hadoop基础教程-第13章 源码编译(13.4 Hive2.1.1源码编译)

第13章 源码编译

13.4 Hive2.1.1源码编译

13.4.1 下载源码

https://mirrors.tuna.tsinghua.edu.cn/apache/hive/

单击stable-2

下载源码apache-hive-2.1.1-src.tar.gz

13.4.2 环境准备

Hive2.1.1的源码包需要JDK1.8。如果使用JDK1.7编译是总是产生各种奇怪的问题,GC overhead limit exceeded

使用Ali镜像时出现问题

The POM for org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde is missing, no dependency information available

于是,不启用Ali镜像

[root@cyq apache-hive-2.1.1-src]# vi /opt/apache-maven-3.3.9/conf/settings.xml
  <mirrors>
    <!-- mirror
     | Specifies a repository mirror site to use instead of a given repository. The repository that
     | this mirror serves has an ID that matches the mirrorOf element of this mirror. IDs are used
     | for inheritance and direct lookup purposes, and must be unique across the set of mirrors.
     |
    <mirror>
      <id>mirrorId</id>
      <mirrorOf>repositoryId</mirrorOf>
      <name>Human Readable Name for this Mirror.</name>
      <url>http://my.repository.com/repo/path</url>
    </mirror>
     -->
       <!--
    <mirror>
        <id>nexus-aliyun</id>
        <mirrorOf>*</mirrorOf>
        <name>Nexus aliyun</name>
        <url>http://maven.aliyun.com/nexus/content/groups/public</url>
    </mirror>
       -->
  </mirrors>

13.4.3 开始编译

[root@cyq apache-hive-2.1.1-src]# export MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1024m"
[root@cyq apache-hive-2.1.1-src]# mvn clean package -Phadoop-2 -Pdist -DskipTests -Dtar

[INFO] Reactor Summary:
[INFO] 
[INFO] Hive ............................................... SUCCESS [  0.877 s]
[INFO] Hive Shims Common .................................. SUCCESS [  1.735 s]
[INFO] Hive Shims 0.23 .................................... SUCCESS [  1.321 s]
[INFO] Hive Shims Scheduler ............................... SUCCESS [  0.509 s]
[INFO] Hive Shims ......................................... SUCCESS [  0.415 s]
[INFO] Hive Storage API ................................... SUCCESS [  0.536 s]
[INFO] Hive ORC ........................................... SUCCESS [  1.636 s]
[INFO] Hive Common ........................................ SUCCESS [  2.218 s]
[INFO] Hive Service RPC ................................... SUCCESS [  1.044 s]
[INFO] Hive Serde ......................................... SUCCESS [  1.632 s]
[INFO] Hive Metastore ..................................... SUCCESS [  7.775 s]
[INFO] Hive Ant Utilities ................................. SUCCESS [  0.131 s]
[INFO] Hive Llap Common ................................... SUCCESS [  1.101 s]
[INFO] Hive Llap Client ................................... SUCCESS [  0.708 s]
[INFO] Hive Llap Tez ...................................... SUCCESS [  0.886 s]
[INFO] Spark Remote Client ................................ SUCCESS [  1.677 s]
[INFO] Hive Query Language ................................ SUCCESS [ 36.962 s]
[INFO] Hive Llap Server ................................... SUCCESS [ 38.075 s]
[INFO] Hive Service ....................................... SUCCESS [01:26 min]
[INFO] Hive Accumulo Handler .............................. SUCCESS [ 31.816 s]
[INFO] Hive JDBC .......................................... SUCCESS [01:37 min]
[INFO] Hive Beeline ....................................... SUCCESS [ 15.614 s]
[INFO] Hive CLI ........................................... SUCCESS [  0.772 s]
[INFO] Hive Contrib ....................................... SUCCESS [  0.536 s]
[INFO] Hive HBase Handler ................................. SUCCESS [ 20.985 s]
[INFO] Hive HCatalog ...................................... SUCCESS [ 48.139 s]
[INFO] Hive HCatalog Core ................................. SUCCESS [  5.561 s]
[INFO] Hive HCatalog Pig Adapter .......................... SUCCESS [  4.961 s]
[INFO] Hive HCatalog Server Extensions .................... SUCCESS [ 25.777 s]
[INFO] Hive HCatalog Webhcat Java Client .................. SUCCESS [  0.893 s]
[INFO] Hive HCatalog Webhcat .............................. SUCCESS [ 29.462 s]
[INFO] Hive HCatalog Streaming ............................ SUCCESS [  0.941 s]
[INFO] Hive HPL/SQL ....................................... SUCCESS [ 24.698 s]
[INFO] Hive HWI ........................................... SUCCESS [  0.588 s]
[INFO] Hive Llap External Client .......................... SUCCESS [  0.576 s]
[INFO] Hive Shims Aggregator .............................. SUCCESS [  0.022 s]
[INFO] Hive TestUtils ..................................... SUCCESS [  0.041 s]
[INFO] Hive Packaging ..................................... SUCCESS [ 42.897 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:57 min
[INFO] Finished at: 2017-07-28T14:56:43+08:00
[INFO] Final Memory: 271M/1300M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop-2" could not be activated because it does not exist.
您在 /var/spool/mail/root 中有新邮件
[root@cyq apache-hive-2.1.1-src]# 

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

发表于

我来说两句

0 条评论
登录 后参与评论

相关文章

来自专栏醉生梦死

MySQL数据导出工具 mysqldump 原

972
来自专栏杨建荣的学习笔记

11g备库无法开启ADG的原因分析 (r7笔记第62天)

今天碰到一个有些奇怪的问题,但是奇怪的现象背后都是有本质的因果。 下午在做一个环境的检查时,发现备库是在mount阶段,这可是一个11gR2的库,没有ADG实在...

3504
来自专栏乐沙弥的世界

中小型数据库 RMAN CATALOG 备份恢复方案(三)

      在前两篇文章中描述了中小型数据库使用RMAN catalog设计备份与恢复方案,并给出了所有相关的脚本来从某种车程度上模拟Oracle Data G...

531
来自专栏乐沙弥的世界

使用crs_profile管理RAC资源配置文件

    profile通常指配置文件,crs_profile望文生义可知,就是管理集群的配置文件。在Oraclele RAC中,所有的CRS资源存放在OCR磁盘...

603
来自专栏沃趣科技

MySQL中的统计信息相关参数介绍

统计信息的作用 上周同事在客户现场遇到了由于统计信息的原因,导致应用数据迁移时间过慢,整个迁移差点失败。关键时刻同事发现测试环境与生产环境SQL语句执行计划不一...

33310
来自专栏数据和云

你不可不看的 Oracle RAC 日常基本维护命令

$ srvctl status instance -d orcl -i orcl2

1004
来自专栏杨建荣的学习笔记

11g Dataguard中的snapshot standby特性(r8笔记第49天)

11g中的ADG特性本身已经非常有特色,促使很多对于10g中不太灵便的备库升级到11g,对于DBA是一大福利,那么还有一个福利就是snapshot standb...

2745
来自专栏电光石火

mysql 找回误删表的数据办法

有备份的话很简单,只需要生成一个最近备份的数据 然后用mysqlbinlog找回备份时间点之后的数据 再恢复到现网即可。

18310
来自专栏Netkiller

Apache Sqoop 将mysql导入到Hadoop HDFS

第 21 章 Apache Sqoop 目录 21.1. 安装 Sqoop 21.2. sqoop2-tool 21.2.1. verify 21.2.2. u...

4877
来自专栏乐沙弥的世界

Oracle健康监控及健康检查(Health Monitor)

Oracle数据库包括一个名为Health Monitor的框架,用于运行诊断检查数据库的各种组件。Oracle健康监视器检查各种组件数据库,包括文件,内存,事...

750

扫码关注云+社区