| 查看: 986 | 回复: 9 | ||
| 【奖励】 本帖被评价1次,作者yj222增加金币 0.5 个 | ||
| 当前主题已经存档。 | ||
| 当前只显示满足指定条件的回帖,点击这里查看本话题的所有回帖 | ||
[资源]
【转贴】 GOOGLE强大的搜索功能揭密【已搜无重复】
|
||
|
PDF格式: 以下是该文中所介绍核心算法的摘要: ABSTRACT MapReduce is a programming model and an associated implementation for processing and generating large data sets. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associated with the same intermediate key. Many real world tasks are expressible in this model, as shown in the paper. Programs written in this functional style are automatically parallelized and executed on a large cluster of commodity machines. The run-time system takes care of the details of partitioning the input data, scheduling the program's execution across a set of machines, handling machine failures, and managing the required inter-machine communication. This allows programmers without any experience with parallel and distributed systems to easily utilize the resources of a large distributed system. Our implementation of MapReduce runs on a large cluster of commodity machines and is highly scalable: a typical MapReduce computation processes many terabytes of data on thousands of machines. Programmers nd the system easy to use: hundreds of MapReduce programs have been implemented and upwards of one thousand MapReduce jobs are executed on Google's clusters every day. [ Last edited by 幻影无痕 on 2007-8-9 at 14:02 ] |
» 猜你喜欢
0854电子信息求调剂 324
已经有3人回复
303求调剂
已经有3人回复
336求调剂
已经有3人回复
306求调剂
已经有9人回复
工科0856求调剂
已经有4人回复
工科材料085601 279求调剂
已经有10人回复
081700 调剂 267分
已经有4人回复
276求调剂。有半年电池和半年高分子实习经历
已经有9人回复
263求调剂
已经有9人回复
求老师收我
已经有3人回复
4楼2007-10-14 14:40:43













回复此楼