Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Journal of Computer Research and Development》 2007-12
Add to Favorite Get Latest Update

DHMC:An Improved Parallel & Distributed Storage Structure for High-Dimensional Cube

Hu Kongfa1,2, Chen Ling1, Zhao Maoxian3, Da Qingli2, and Ji Zhaohui1 1(Department of Computer Science and Engineering, Yangzhou University, Yangzhou 225009) 2(School of Economics & Management, Southeast University, Nanjing 210096) 3(College of Information Science and Engineering, Shandong University of Science and Technology, Qingdao 266510)  
Data cube and its pre-computation have been playing an essential role in fast OLAP (online analytical processing) in many data warehouses. For the cube with d dimensions, it can generate 2d cuboids and multiply from i=1 to d(|Di|+1) aggregate cells. But in a high-dimensional cube, it might not be practical to build all these cuboids. In this paper, a novel parallel and distributed storage structure is proposed for high-dimensional cube based on shell segment mini-cubes (DHMC). DHMC partitions the high dimensional cube into some low-dimensional shell segment mini-cubes. OLAP queries are computed online by dynamically constructing cuboids from these shell segment mini-cubes through the parallel distributed processing system. With this design, for high-dimensional OLAP, the total space that needs to store such shell segment mini-cubes is negligible in comparison with a high-dimensional cube. Such an approach permits a significant reduction of CPU and I?O overhead for many queries by restricting the number of cube segments to be processed for both the fact table and bitmap indices. The proposed data allocation and processing model supports parallel I?O and parallel processing, as well as load balancing for disks and processors. The methods of shell mini-cube are compared with other existing ones such as full cube and partial cube. The analytical and experimental results show that the algorithms of DHMC proposed are more efficient than the other existing ones.
【Fund】: 国家自然科学基金项目(60773103 60473012 70472033);; 国家科技基础条件平台基金项目(2004DKA20310);; 江苏省自然科学基金项目(BK2005047 BK2005046);; 江苏省“青蓝工程”基金项目
【CateGory Index】: TP311.13
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
【References】
Chinese Journal Full-text Database 1 Hits
1 GUO Jun-feng1,2,NI Zhi-wei1,2,GAO Ya-zhuo1,2,WU Zhang-jun1,2(1.School of Management,Hefei University of Technology,Hefei 230009,China;2.Key Laboratory of Process Optimization & Intelligent Decision-making,Ministry of Education,Hefei University of Technology,Hefei 230009,China);Efficient method for improving query efficiency in data warehouse[J];Computer Integrated Manufacturing Systems;2009-12
【Citations】
Chinese Journal Full-text Database 1 Hits
1 HU Kong Fa, DONG Yi Sheng, XU Li Zhen, and YANG Ke Hua (Department of Computer Science and Engineering, Southeast University, Nanjing 210096);A Novel Aggregation Algorithm for Online Analytical Processing Queries Evaluation Based on Dimension Hierarchical Encoding[J];Journal of Computer Research and Development;2004-04
【Co-citations】
Chinese Journal Full-text Database 10 Hits
1 Hu Kongfa~(1,2) Dong Yisheng~2 Chen Ling~1(~1 Department of Computer Science and Engineering, Yangzhou University, Yangzhou 225009, China)(~2Department of Computer Science and Engineering, Southeast University, Nanjing 210096, China);Bitmap index based on dimension hierarchical encoding in data warehouse[J];Journal of Southeast University (Natural Science Edition);2005-02
2 Yang Kehua1 Hu Kongfa 1,2 (1Department of Computer Science and Engineering, Southeast University, Nanjing 210096, China)(2Department of Computer Science and Engineering, Yangzhou University, Yangzhou 225009, China);Storage optimization method of Data Cube based on hierarchy of dimension[J];Journal of Southeast University (Natural Science Edition);2005-04
3 Hu Kongfa Chen Ling Li Bin(Department of Computer Science and Engineering,Yangzhou University, Yangzhou 225009,China);Improved method of parallel construction and storage for high-dimensional hierarchy aggregate Cube[J];Journal of Southeast University(Natural Science Edition);2006-01
4 YANG Ke-hua,ZHANG Wei (School of Computer and Communication,Hunan Univ,Changsha,Hunan 410082,China);A Data Cube Dimension Hierarchical Encoding Based on Multiple Hierarchy Chain[J];Journal of Hunan University(Natural Sciences);2007-09
5 Yang Kehua~1, Dong Yisheng~1, and Hu Kongfa~1,2~1(Department of Computer Science and Engineering, Southeast University, Nanjing 210096)~2(Department of Computer Science and Engineering, Yangzhou University,Yangzhou 225009);A Hierarchical Clustering Method on Semantic Cube[J];Journal of Computer Research and Development;2005-11
6 DAI Chang-hua,ZHANG Chong,TANG Jiu-yang,XIAO Wei-dong School of Information System and Management,National University of Defense Technology,Changsha 410073,China;Method of organizing geographic multidimensional semantic information based on ontology[J];Computer Engineering and Applications;2008-29
7 HU Kong-fa~1,CHEN Ling~1,LI Bin~1,CHEN Hong-jian~1,DONG Yi-sheng~2(1.Dep.of Computer Sci.& Eng.,Yangzhou Univ.,Yangzhou 225009,China;2.Dep.of Computer Sci.& Eng.,Southeast Univ.,Nanjing 210096,China);Storage technology of high-dimensional OLAP aggregate data in data warehouse system[J];Computer Integrated Manufacturing Systems;2006-07
8 HU Kong-fa~(1,2),CHEN Ling~1,GU Qi~1,CAI Jun-jie~1,DONG Yi-sheng~2(1.Dep.of Computer Sci.& Eng.,Yangzhou Univ.,Yangzhou 225009,China;2.Dep.of Computer Sci.& Eng.,Southeast Univ.,Nanjing 210096,China);Rapid multi-dimension hierarchical aggregation algorithm in data warehouse system[J];Computer Integrated Manufacturing Systems;2007-01
9 SONG Xu-dong1,2,HU Mo-qian1,LIU Xiao-bing2(1.Software School,Dalian Jiaotong University,Dalian 116028,China;2.CIMS Center,Dalian University of Technology,Dalian 116024,China);On-line analysis processing development method based on model driven architecture[J];Computer Integrated Manufacturing Systems;2010-02
10 HUANG Yu-ming1,MAO Yu-guang1,2(1.College of Information & Technology,Nanjing University of Aeronautics andAstronautics,Nanjing 210016,China;2.State Key Laboratory for Novel Software Technology,Nanjing University,Nanjing 210093,China);A Hierarchical Encoding Solution of Multi-Granularity in Data Warehouse[J];Computer Technology and Development;2008-10
China Proceedings of conference Full-text Database 2 Hits
1 ;A Temporal View Maintenance Strategy in Data Warehouse[A];[C];2005
2 ;Study and Application on a Rank-divided OLAP Model[A];[C];2006
【Co-references】
Chinese Journal Full-text Database 10 Hits
1 Hu Kongfa Chen Ling Li Bin(Department of Computer Science and Engineering,Yangzhou University, Yangzhou 225009,China);Improved method of parallel construction and storage for high-dimensional hierarchy aggregate Cube[J];Journal of Southeast University(Natural Science Edition);2006-01
2 LI Sheng En 1 and WANG Shan 2 1 (Department of Computer, Shandong Institute of Architecture and Engineering, Jinan 250014) 2 (Information School, Renmin University of China, Beijing 100872);Star Cube——An Approach to Implementing Data Cube Efficiently[J];Journal of Computer Research and Development;2004-04
3 Wen Juan~1, Xue Yongsheng~1, Weng Wei~1,2, and Lin Ziyu~1,3~1(Computer Science Department, Xiamen University, Xiamen 361005)~2(Electronic Engineering Department, Xiamen University of Technology, Xiamen 361005)~3(Department of Computer Science and Technology, Peking University, Beijing 100871);An Efficient Method for Multi-Table Joining in Data Warehouse[J];Journal of Computer Research and Development;2005-11
4 DENG Pan,LIU Gong-shen Department of Information Security,Shanghai Jiaotong University,Shanghai 200240,China;Effective storage structure of inverted index[J];Computer Engineering and Applications;2008-31
5 LI Cui-Ping;WANG Shan Information School, Renmin University of China, Beijing 100872;Effcient Approximate Update to Data Cube[J];Computer Science;2005-09
6 DING Hu-Lin;FENG Jian-Lin;NIE Jing Department of Computer Science, Huazhong University of Science and Technology, Wuhan 430074;Indexing PrefixCube[J];Computer Science;2005-10
7 LIU Yun-Tao;BAO Yu-Bin;WU Dan;LENG Fang-Ling;SUN Huan-Liang;YU Ge School of Information Science and Engineering, Northeastern University, Shenyang 110004;CBFrag-Cubing: An Algorithm of High-Dimensional Data Cubing Based on Compressed Bitmap[J];Computer Science;2005-11
8 GAO Ya-zhuo NI Zhi-wei GUO Jun-feng HU Tang-lei(School of Management,Hefei University of Technology,Hefei 230009,China)(Key Laboratory of Process Optimization and Intelligent Decision-making of Ministry of Education,Hefei University of Technology,Heifei 230009,China);Research on Interest-driven Iceberg Cube Construction and Incremental Update Method[J];Computer Science;2009-12
9 ZHAO Peiying, LI Qingzhong, WANG Haiyang ( Institute of Computer Science and Technology, Shandong University(East), Jinan 250010);A Parallel Multi-join Algorithm for Improving Query Performance in Data Warehouse[J];Computer Engineering;2002-10
10 YU Bo1,ZHAO Zheng2,TANG Shiwei1(1.Center for Information Science,Peking University,Beijing 100871,China;2.College of Information and Engineering Control,Xian University of Architecture and Technology,Xian Shaanxi 710054,China);Computation of CUBE in OLAP[J];Computer Applications;2003-01
【Secondary References】
Chinese Journal Full-text Database 1 Hits
1 LUO Xian-xian(Software School,South China University of Technology,Guangzhou Guangdong 510006,China);Application of data warehouse technology in energy management of urban public buildings[J];Journal of Computer Applications;2011-10
【Secondary Citations】
Chinese Journal Full-text Database 1 Hits
1 JIANG Xu-dong, FENG Jian-hua, ZHOU Li-zhu (Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China);A Novel Aggregation Algorithm for Online Analytical Processing Query Evaluation[J];Journal of Software;2002-01
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved