前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >CentOS大数据实验环境更改记录

CentOS大数据实验环境更改记录

作者头像
py3study
发布2020-01-03 10:26:05
5250
发布2020-01-03 10:26:05
举报
文章被收录于专栏:python3python3

CentOS大数据实验环境更改记录

标签(空格分隔): 未分类


1.修改163的yum源

使用说明

首先备份/etc/yum.repos.d/CentOS-Base.repo

代码语言:javascript
复制
mv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backup

下载对应版本repo文件, 放入/etc/yum.repos.d/(操作前请做好相应备份)

CentOS6

运行以下命令生成缓存

代码语言:javascript
复制
yum clean all
yum makecache

2.更新python从2.6.6版本为2.7

代码语言:javascript
复制
#wget http://www.python.org/ftp/python/2.7.5/Python-2.7.5.tar.bz2
#tar jxvf Python-2.7.5.tar.bz2
#cd Python-2.7.5
#./configure --prefix=/usr/local 
#make && make altinstall 
#mv /usr/bin/python /usr/bin/python2.6.6
#ln -s /usr/local/bin/python2.7 /usr/bin/python

3.安装pip 1)安装setuptools 解压安装遇到错误 RuntimeError: Compression requires the (missing) zlib module

代码语言:javascript
复制
yum install zlib& zilib devel

然后遇到yum因为python版本不对错误错误:

代码语言:javascript
复制
[root@localhost bin]# yum install pip
There was a problem importing one of the Python modules
required to run yum. The error leading to this problem was:

   No module named yum

Please install a package which provides this module, or
verify that the module is installed correctly.

It's possible that the above module doesn't match the
current version of Python, which is:
2.7.3 (default, Jan 16 2016, 05:59:11) 
[GCC 4.4.6 20120305 (Red Hat 4.4.6-4)]

If you cannot solve this problem yourself, please go to 
the yum faq at:
  http://yum.baseurl.org/wiki/Faq

查找yum文件,并编辑此py文件

代码语言:javascript
复制
[root@develop local]# which yum
/usr/bin/yum
[root@develop local]# vi /usr/bin/yum

将
#!/usr/bin/python
改为:
#!/usr/bin/python2.6

然后保存OK.

补充:yum基于python写的。

4.安装zlib&zlib-devel 重新编译python /.configure make make install 然后重新安装setuptools

5.遇到wangqi is not in the sudoers file.

代码语言:javascript
复制
#visudo
## Allow root to run any commands anywhere
root    ALL=(ALL)       ALL
wangqi  ALL=(ALL)       ALL

6.遇到ImportError: cannot import name HTTPSHandler yum install openssl openssl-devel -y 之后,再重新安装Python即可。 /.configure make make install

7.pip安装完成 8.安装numpy, 9.安装pandas 出现问题: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 32: ordinal not in range(128) 解决方法: 修改mimetypes.py文件,路径位于python的安装路径下的Lib\mimetypes.py文件。在import下添加如下几行:

代码语言:javascript
复制
if sys.getdefaultencoding() != 'gbk': 
    reload(sys) 
    sys.setdefaultencoding('gbk')

依然报错:

代码语言:javascript
复制
gcc: error trying to exec 'cc1plus': execvp: No such file or directory

error: command 'gcc' failed with exit status 1

尝试解决: yum -y install gcc

依然报错:

代码语言:javascript
复制
Command /usr/local/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/pandas/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-5RbGXm-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/pandas
Traceback (most recent call last):
  File "/usr/local/bin/pip", line 9, in <module>
    load_entry_point('pip==1.5.6', 'console_scripts', 'pip')()
  File "/usr/local/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg/pip/__init__.py", line 185, in main
    return command.main(cmd_args)
  File "/usr/local/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg/pip/basecommand.py", line 161, in main
    text = '\n'.join(complete_log)
UnicodeDecodeError: 'gbk' codec can't decode bytes in position 97-98: illegal multibyte sequence

使用安装包直接进行安装,发现是以下问题:

代码语言:javascript
复制
gcc: error trying to exec 'cc1plus': execvp: No such file or directory
error: command 'gcc' failed with exit status 1

安装gcc-c++

代码语言:javascript
复制
[root@localhost pandas-0.17.1]# yum list gcc-c++
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
Available Packages
gcc-c++.i686                                 4.4.7-16.el6                                  base
[root@localhost pandas-0.17.1]# yum -y install gcc-c++.i686 

遇到问题

代码语言:javascript
复制
No local packages or download links found for python-dateutil
error: Could not find suitable distribution for Requirement.parse('python-dateutil')

pip install python-dateutil

终于大功告成

本文参与 腾讯云自媒体分享计划,分享自作者个人站点/博客。
原始发表:2019-09-28 ,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 作者个人站点/博客 前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体分享计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
目录
  • CentOS大数据实验环境更改记录
领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档