Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Computer Engineering & Science》 2011-03
Add to Favorite Get Latest Update

MapReduce:a New Programming Model for Distributed Parallel Computing

LI Cheng-hua,ZHANG Xin-fang,JIN Hai,XIANG Wen(School of Computer Science and Technology,Huazhong University of Science and Technology,Wuhan 430074,China)  
MapReduce is a programming model introduced by Google for writing applications that rapidly process vast amounts of data in parallel on large clusters of computing nodes.The model is inspired by map and reduce functions commonly used in functional programming.A Map/Reduce job usually splits the input data-set into independent chunks which are processed by the map tasks in a completely parallel manner.The reduce tasks merge all intermediate values generated by the map tasks.Users only devote themselves to how to specify the map functions and reduce functions.The details of partitioning the input data,scheduling the program's execution across a set of machines,handling machine failures,and managing the required inter-machine communication are taken care of by the run-time system of MapReduce.MapReduce will be widely adopted on the cloud computing platform.Several aspects of the Hadoop MapReduce contributed by Apache remain to be perfected.
【CateGory Index】: TP338.6
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
【Citations】
Chinese Journal Full-text Database 6 Hits
1 CHEN Kang1,2,ZHENG Wei-Min1,2 1(Tsinghua National Laboratory for Information Science and Technology,Tsinghua University,Beijing 100084,China) 2(Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China);Cloud Computing:System Instances and Current Research[J];Journal of Software;2009-05
2 SUN Guang-zhong, XIAO Feng, XIONG Xi (Department of Computer Sci. and Tech., University of Science and Technology of China, Hefei 230027, China);Study on Scheduling and Fault Tolerance Strategy of MapReduce[J];Microelectronics & Computer;2007-09
3 ZHENG Qi-long1,2,WANG Hao1,2,WU Xiao-wei1,2,FANG Ming1,2(1 National High Performace Computing Center(Hefei),University of Science and Technology of China,Hefei 230026,China;2 High Productivity Software and System Research Laboratory,University of Science and Technology of China,Hefei 230026,China);HPMR:HPC Supporting Platform on Multi-core Cluster[J];Microelectronics & Computer;2008-09
4 ZHENG Qi-long1,2,FANG Ming1,2,WANG Sheng1,2,WANG Xiang-qian1,2, WU Xiao-wei1,2,WANG Hao1,2(1 School of Computer Science and Technology,University of Science and Technology of China,Hefei 230027,China;2 Anhui Key Lab on High Performance Computing,Hefei 230027,China);Scientific Parallel Computing Based on MapReduce Model[J];Microelectronics & Computer;2009-08
5 Wu Baogui(School of Economics and Management,Xidian University,Xi'an 710071,China)Ding Zhenguo(School of Network Education,Xidian University,Xi'an 710071,China);Research of Distributed Search Engine Based on Map/Reduce[J];New Technology of Library and Information Service;2007-08
6 Yang Daiqing1,2 Zhang Zhixiong1 1(National Science Library,Chinese Academy of Sciences,Beijing 100190,China)2(Institute of Scientific and Technical Information of China,Beijing 100038,China);A Method for Generating Co-occurrence Matrix of Mass Data Based on Hadoop[J];New Technology of Library and Information Service;2009-04
【Co-citations】
Chinese Journal Full-text Database 10 Hits
1 ZHANG Zhen-yong, WEN Jing-hua (Guizhou College of Finance and Economics, Guiyang 550004,China);Comparison and Analysis for Relational Database and Cloud Database Based on Architecture[J];Computer Knowledge and Technology;2009-25
2 CAI Jian1, WANG Shu-mei2 (1.Xuzhou Normal University Modern Educational Technology Center, Xuzhou 221116,China; 2.Xuzhou Normal University, School of Computer Science & Technology,Xuzhou 221116, China);Cloud Computing System Instances Based on Google[J];Computer Knowledge and Technology;2009-25
3 Liu Xiaole(School of Information Engineering,Yulin University,Yulin 719000,China);Analysis of Cloud Calculation and its Realization on Computers[J];Electronic Science and Technology;2009-12
4 YIN Jue-qiong (Jiangsu City Vocational College School Wujin Point, Changzhou 213149, China);Analysis of Situation and Problems of Cloud Computing[J];Computer Knowledge and Technology;2009-33
5 Wu Jiyi1,2,Ping Lingdi1,Pan Xuezeng1,Li Zhuo1(1.School of Computer Science and Technology,Zhejiang University,Hangzhou 310027,China;2.Key Lab of E-Business and Information Security,Hangzhou 310036,China);Cloud Computing:Concept and Platform[J];Telecommunications Science;2009-12
6 Sun Jian1,Jia Xiaojing2 (1.China Mobile Communications Corporation,Beijing 100032,China; 2. Central University of Finance and Economics,Beijing 100081,China);A Study of the Influence of Technical Architecture on the Total Cost of Google Cloud Computing Platform[J];Telecommunications Science;2010-01
7 Wei Yi-chen(Information College Capital University of Economics and Business,Beijing 100070);Internet of Things:The Evolution Toward Web3.0[J];Electronics Quality;2010-02
8 LI Yu-ming,ZHANG Cai-neng,XIE Jie (Department of Computer Science ,Shonan Institute,Chengzhou 423000,China);Cloud Computing Environment Data Storage[J];Computer Knowledge and Technology;2010-05
9 LI Sheng(School of Information,Zhongnan University of E&L,Wuhan 430073,China);A Brief Discussion on Cloud Computing[J];Computer Knowledge and Technology;2010-09
10 Wu Jiyi1,2, Fu Jianqing2, Zhang Mingxi3, Ping Lingdi2 (1. Key Lab of E-Business and Information Security, Hangzhou Normal University, Hangzhou 310036, China ; 2. School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China ; 3. School of Computer Science and Technology, Donghua University,Shanghai 201620, China);Cloud Data Management: A Survey[J];Telecommunications Science;2010-05
China Proceedings of conference Full-text Database 4 Hits
1 ZHOU Xuan~1,HUANGP u~2 (1 China Mobile Group Zhejiang Co.,Ltd.,Hangzhou,Zhejiang 310000,China; 2 China Mobile Group Zhejiang Co.,Ltd.Wenzhou Branch.,Wenzhou,Zhejiang,325000,China);A Mobile Service Testing System On OMSP latform With Cloud Computing Infrastructure[A];[C];2009
2 Zhao Wei~1 Chen Cheng-shou~2 Li Li-jun~2 (1.School of Information Technology,Jilin Agricultural University,Jilin,Changchun,130118) (2.School of Computer Science & Engineering,Changchun University of Technology,Jilin,Changchun,130012);The Collision Detection Algorithm Based on the MapReduce of Cloud Computing[A];[C];2010
3 Liu Zhenyu~(1,2),Lu Tun~1,Liu Tiejiang~1,and Yang Genxing~2 1(School of Computer Science,Fudan University,Shanghai 200433) 2(Shanghai Key Laboratory of Computer Software Evaluating and Testing,Shanghai 201112);Service Online Quality Evaluation Method in Cloud Computing Environment[A];[C];2010
4 PAN Song-bai ZHANG Yun-yong CHEN Qing-jin WEI Jin-wu (Research Institute of China Unicom,Beijing 100048);Requirements and Policies of Cloud Computing Security[A];[C];2010
【Secondary Citations】
Chinese Journal Full-text Database 4 Hits
1 Yao Shuyu Zhao Shaodong (Department of Computer Science, Zhongshan University, Guangzhou Guangdong 510275, China);A SEARCH ENGINE USING DISTRIBUTED TECHNOLOGY[J];Computer Applications and Software;2005-10
2 JIANG Jian-hong(College of Software and Microelectronics, Northwestern Polytechnical University, Xi'an 710065,P.R.China);Research of Main Distributed Search Engine Technology[J];Science Technology and Engineering;2007-10
3 Dong Huashan and Sun Jiqing (Information Science and Engineering Department,East China University of Science and Technology,Shanghai 200237);Research of Distributed Searches Mode Based on P2P[J];Journal of The China Society For Scientific and Technical Information;2004-06
4 ZHENG Qi-long1,2,WANG Hao1,2,WU Xiao-wei1,2,FANG Ming1,2(1 National High Performace Computing Center(Hefei),University of Science and Technology of China,Hefei 230026,China;2 High Productivity Software and System Research Laboratory,University of Science and Technology of China,Hefei 230026,China);HPMR:HPC Supporting Platform on Multi-core Cluster[J];Microelectronics & Computer;2008-09
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved