前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >Python map()函数

Python map()函数

作者头像
Steve Wang
发布2018-02-05 17:46:08
8430
发布2018-02-05 17:46:08
举报

MapReduce: Simplified Data Processing on Large Clusters Jeffrey Dean and Sanjay Ghemawat https://research.google.com/archive/mapreduce.html 这篇来自谷歌的论文介绍了map/reduce,摘录如下:

Abstract MapReduce is a programming model and an associated implementation for processing and generating large data sets. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associated with the same intermediate key. Many real world tasks are expressible in this model, as shown in the paper. Programs written in this functional style are automatically parallelized and executed on a large cluster of commodity machines. The run-time system takes care of the details of partitioning the input data, scheduling the program’s execution across a set of machines, handling machine failures, and managing the required inter-machine communication. This allows programmers without any experience with parallel and distributed systems to easily utilize the resources of a large distributed system. Our implementation of MapReduce runs on a large cluster of commodity machines and is highly scalable: a typical MapReduce computation processes many terabytes of data on thousands of machines. Programmers find the system easy to use: hundreds of MapReduce programs have been implemented and upwards of one thousand MapReduce jobs are executed on Google’s clusters every day.

简而言之,map()和reduce()是在集群式设备上用来做大规模数据处理的方法,用户定义一个特定的映射,函数将使用该映射对一系列键值对进行处理,直接产生一系列键值对。

Python map()函数

Python可以接收函数作为参数。

map()是Python内置的高级函数之一,该函数可以接受其他函数作为参数,对一个序列的所有元素做该函数的映射,返回处理结果的一个map类型的对象。

同iterator,map也是一个可迭代对象。

map()用法
map(function, iterable, ...)   #意即可接超过2个参数

形式:map(函数, 可迭代对象) 其语法意义就是,是用给出的函数对所有可迭代对象进行处理,返回一个map类型的对象,请注意,Java中map是键值对,相当于Python的dict,而Python中的map是一个类似与list的数据类型,不是键值对。

#!usr/bin/env python3
#_*_ coding: utf-8 _*_
def square(x):
    return x * x
i =  map(square, range(1,6))
print(i)
print(list(i))  #map是惰性序列,使用list计算出其所有元素的值

#结果:
<map object at 0x035E2190>
[1, 4, 9, 16, 25]
本文参与 腾讯云自媒体分享计划,分享自作者个人站点/博客。
原始发表:2017年12月18日,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 作者个人站点/博客 前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体分享计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
目录
  • Python map()函数
    • map()用法
    领券
    问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档