首页
学习
活动
专区
工具
TVP
发布
精选内容/技术社群/优惠产品,尽在小程序
立即前往
您找到你想要的搜索结果了吗?
是的
没有找到

hadoop记录

RDBMS Hadoop Data Types RDBMS relies on the structured data and the schema of the data is always known. Any kind of data can be stored into Hadoop i.e. Be it structured, unstructured or semi-structured. Processing RDBMS provides limited or no processing capabilities. Hadoop allows us to process the data which is distributed across the cluster in a parallel fashion. Schema on Read Vs. Write RDBMS is based on ‘schema on write’ where schema validation is done before loading the data. On the contrary, Hadoop follows the schema on read policy. Read/Write Speed In RDBMS, reads are fast because the schema of the data is already known. The writes are fast in HDFS because no schema validation happens during HDFS write. Cost Licensed software, therefore, I have to pay for the software. Hadoop is an open source framework. So, I don’t need to pay for the software. Best Fit Use Case RDBMS is used for OLTP (Online Trasanctional Processing) system. Hadoop is used for Data discovery, data analytics or OLAP system. RDBMS 与 Hadoop

03

hadoop记录 - 乐享诚美

RDBMS Hadoop Data Types RDBMS relies on the structured data and the schema of the data is always known. Any kind of data can be stored into Hadoop i.e. Be it structured, unstructured or semi-structured. Processing RDBMS provides limited or no processing capabilities. Hadoop allows us to process the data which is distributed across the cluster in a parallel fashion. Schema on Read Vs. Write RDBMS is based on ‘schema on write’ where schema validation is done before loading the data. On the contrary, Hadoop follows the schema on read policy. Read/Write Speed In RDBMS, reads are fast because the schema of the data is already known. The writes are fast in HDFS because no schema validation happens during HDFS write. Cost Licensed software, therefore, I have to pay for the software. Hadoop is an open source framework. So, I don’t need to pay for the software. Best Fit Use Case RDBMS is used for OLTP (Online Trasanctional Processing) system. Hadoop is used for Data discovery, data analytics or OLAP system. RDBMS 与 Hadoop

03

python 基础篇(一)

默认的python的文件为:文件名.py #!/usr/bin/env python    # coding=utf-8     对中文的支持(切记:等号两边没有空格) 执行python 文件: [root@localhost Desktop]# python test1.py [root@localhost Desktop]# chmod +x test1.py [root@localhost Desktop]# ./ test1.py 变量: 指向内存的一个符号 不同文件系统也是属于不同的类型   它作用于磁盘 python:强类型的动态语言  “变量可以替换,包括变量的类型” 数据类型分为两大类: 数字类型和字符串类型 >>> a = 1 >>> type(a) <type 'int'> >>> a= 'str' >>> type(a) <type 'str'> 不同的数据类型时不能做变换的 >>> a='hello' >>> b= 'world' >>> a+b 'helloworld' 同其他语言一样 在python中: 从高精度向低精度转换时会存在数据损失,在低精度向高精度转换时不会存在 程序=数据结构+算法 优先级: 单目>双目  (单目:! 双目运算符:+ - * / ;在python里面没有三目运算符) 算术运算符 > 位操作运算符>比较运算符>逻辑运算符   算术运算符: + - * / % 位操作运算符: << >> & ^ | ~ 比较运算符: < <= > >= != 逻辑运算符:and or not 赋值= () 优先级最大  赋值= 优先级最小 表达式: 除法运算: >>> 10/3 3 >>> 10/3.0 3.3333333333333335 >>> 10.0/3 3.3333333333333335 幂运算: >>> 2**4 16 除法取整运算: >>> 10//3.0 3.0 >>> 10.0//3 3.0 >>> 10//3 3 取模运算: >>> 10%3 1 >>> 10%3.0 1.0 按位与   &   全为真则为真 或      |   有一个为真则为真 异或     ^   有两个不同时则为真,相同时则为假 >>> 2<<3  00010 左移3位 10 000=2**4 16 >>> 2>>3  00010 右移三位出界则为零 0 >>> 3&2   按位与:11&10 => 10 2 >>> 3^2      异或: 11^10 => 01 1 >>> 3|2   按位或:11|10 => 11 3 程序结构: if 语句   只能进入一个分支执行且执行完跳出     在if语句中只有一个 else  可有多个 elif 分支语句只有一个if 循环语句:while   for     break continue   且循环里面可以有else while condition:     expression for item in  迭代器(列表,元组等)     expression break     退出整个循环体 continue  退出当前循环 python的内置容器有: 列表,元组,字典,集和, >>> a= [1,4,5,'lo']    ##定义一个列表   列表中的元素没有要求 且列表可以嵌套 >>> type(a)           ##type() 查看类型 <type 'list'> range() 得到一个列表 >>> range(0,2) [0, 1] >>> dir(a)    ##可以查看对于一个容器能够执行的操作   ['__add__', '__class__', '__contains__', '__delattr__', '__delitem__', '__delslice__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getitem__', '__getslice__', '__gt__', '__hash__', '__iadd__', '__imul__', '__init__', '__iter__', '__le__', '__len__', '__lt__', '__mul__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__reversed__', '__rmul__', '__setattr__', '__setitem__', '__setslice__', '__sizeof__', '__str__', '__subclasshook__', 'append', 'c

01
领券